I'm new to Matillion and not worked with SMB before. I'm looking to create a process that transfers files from an on-prem fileshare to Azure Blob. I've looked at the Data Transfer component and entered what I believe are the valid options however I receive a generic Connection Timeout in the Task Log.
My SMB URL is structured; smb://domain%3Buser:password@fqdnoffileserver(no port specified)/fileshare/dirname/test.txt.
Are there any pre-req steps I need complete such as enabling SMB on the fileserver/share in question or could this be a firewall issue preventing access?
Hi @Treaders , to quickly answer you question... It could be both. SMB needs to be enabled on the server where the fileshare is at. It also needs to be configured to share the directory you plan to gain access to. There could also be firewall restrictions on your network that could prevent the connection to the source (SMB fileshare) and/or destination (Azure Blob) depending how your Azure and network infrastructure is setup. There are a lot of pieces and scenarios at play, which makes it hard to narrow this down. I would definitely start by getting SMB setup on the source and make sure you can connect to it via any method. This get's your foot in the door. The next step would be to test connecting to it from the Matillion instance. If there is still a failure, you might have someone check the network logs to see if you can see anything being blocked via a firewall or filtering rule. You may be able to glean a little more detailed information out of the Matillion Server logs as well.
I hope this helps in some way. Report back on your progress if you have time.
Thanks for responding. I've requested the network team open up ports 139/445 between the Matillion instance and the fileserver. As you say, once that's done I can start testing and narrowing down any other issues. I'll keep you posted.
Hi @Bryan (Customer) , Just to update you that after enabling the firewalls between source and target, the pysmb process works for clearing up on prem files. I've also created a separate Bash script utilising the Azure CLI to run some maintenance scripts on Blob as well.