How can I reference the CSV created from a Writer to upload to AWS S3 using S3Connector? I can successfully use a Reader to reference a file on my computer and upload to AWS S3 using my Web Connection and S3Connector, but I don't know how to reference a newly created file within my worflow. See attached.
Solved
How to reference CSV from Writer for S3Connector?
+1Best answer by chrisatsafe
Hi @osdev ,
You'll likely want to use a FeatureWriter instead. The FeatureWriter is essentially the transformer version of a writer which allows you to continue processing after a file has been created. If you replace your CSV writer with a FeatureWriter, you can simply connect the summary port to the S3Connector and use the summary attribute _dataset to set the file to upload (i.e. @Value(_dataset)\\<filename>.csv).
If you want to only create a temporary csv you can also mix in a TempPathnameCreator.
+2- Contributor
- Best Answer
Hi @osdev ,
You'll likely want to use a FeatureWriter instead. The FeatureWriter is essentially the transformer version of a writer which allows you to continue processing after a file has been created. If you replace your CSV writer with a FeatureWriter, you can simply connect the summary port to the S3Connector and use the summary attribute _dataset to set the file to upload (i.e. @Value(_dataset)\\<filename>.csv).
If you want to only create a temporary csv you can also mix in a TempPathnameCreator.
Reply
Rich Text Editor, editor1
Editor toolbars
Press ALT 0 for help
Helpful Members This Week
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.