Hi ,
We need to transfer files from a remote sftp server to blob by using file pattern instead of giving exact file name.Currently we are transferring files giving the exact name in the data transfer component.Is it possible to transfer files using a file pattern in data transfer component or any other component
I need to do the exact same thing. It seems like it should be possible using the File Iterator component in conjunction with the Data Transfer component, but I cannot get that to work. The File Iterator allows for Regex matching and supports SFTP. You might give it a try. I cannot seem to get it to work for me using SFTP. I've submitted a case to see if I'm doing something wrong.
It's possible by first building a grid variable of "source" details using an sftp File Iterator, then using a Grid Iterator to transfer each "source" file individually.
Doesn't feel like the most elegant solution but it works and allows you to control the target location relatively easily.
...and include your regex in the initial SFTP File Iterator.
I'm trying to do this, but no matter how I configure the File Iterator, I get either "Exception: Error opening sftp connection" or "Exception: 2: File not found: /" - I'm unclear if I have the URL specified correctly.
Hi,
Can you please show how you have defined the parameters for file iterator and data transfer components ? I am many interested in the input url, variables for file iterator and target filename in the data transfer component as the target file name in the data transfer component need to change for each of the file that is transfereed
I should note that the Data Transfer component works fine for me with a specific file name.
File not found sounds more promising...
We had an issue where the file path needed to be included in the regex or appended to the SFTP url.
regex pattern matches are against fully qualified filenames rather than just the name.
I've been playing with that, but so far nothing but "File not found: /". Thanks again for your suggestions.
Hi,
Can you share the mapping by exporting it ? so that we can reuse it by making appropriate changes
I am getting the following error com.jcraft.jsch.JSchException: Auth cancel
Has anyone else see this?
See screenshots above for example of the File Iterator.
Have you confirmed files exists in the home directory and/or enabled the recursive option?
Thanks so much for this. The key was to set "Set Home Directory as Root" to YES. I had it set to the default value of NO and that wasn't working. It now works for me. Thanks!
I have not. Mine is working now. Sorry you're continuing to have problems. Are you able to transfer a single known file using the Data Transfer component?
Not able to connect to the server.
