I have an ArcGIS Online hosted feature layer containing point features that have attachments enabled. Could someone help me with some advice for how to use the ArcGIS Online feature reader that will allow me to access the features and their associated attachments (if there are any-not all features have an attachment)? It is easy enough to get the features, but I can't see a way to access the attachments. Thank you!
Solved
Reading ArcGIS Online feature attachments
Best answer by mark2atsafe
Looks like build 17475 is the one to use. It has the most recent fixes. See safe.com/beta for the newest betas. The functionality has been checked and verified by the quality team.
@runneals - I don't see any documentation, but according to the notes I have seen there is a new parameter on each reader feature type. It's called 'Include Attachments' and defaults to No (in case you're wondering, it's quicker and more backwards compatible to not default to yes).
So, if you set that, it should return features with the following format attributes:
New format attributes on all features:
- arcgisonline_objectid (always)
- arcgisonline_globalid (when globalids present)
New format attributes for attachments, present on features that have attachment(s):
- arcgisonline_attachment{}.id
- arcgisonline_attachment{}.globalid
- arcgisonline_attachment{}.size
- arcgisonline_attachment{}.name
- arcgisonline_attachment{}.content_type
- arcgisonline_attachment{}.data
So it looks to me like the attachment will be in the form of a data attribute, which you could then write to an output file using the AttributeFileWriter transformer.
Let me know if this doesn't help and I can investigate further,
Regards
Mark
This post is closed to further activity.
It may be a question with a best answer, an implemented idea, or just a post needing no comment.
If you have a follow-up or related question, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
It may be a question with a best answer, an implemented idea, or just a post needing no comment.
If you have a follow-up or related question, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
+3- Contributor
Reading attachments from features is not currently possible using the ArcGIS Online reader (nor can you write them with the Writer). Within FME, your options are to either use the Pythoncaller or to request the attachments from the relevant features using the HTTPCaller (or equivalent transformer).
+5- Contributor
ngoorman wrote:
Reading attachments from features is not currently possible using the ArcGIS Online reader (nor can you write them with the Writer). Within FME, your options are to either use the Pythoncaller or to request the attachments from the relevant features using the HTTPCaller (or equivalent transformer).
+55- Safer
pcgveenstra wrote:
But apparently it is not possible with the read as-is. But it surely would be nice. I am going to share two links on how to do this manually (and one via FME). I am going to try them to see how they work. From CloudPoint (Manual Method). From Lars de Vries. (via FME). This would surely make a nice enhancement to the AGOL reader.
+9- Contributor
@Mark2AtSafe
Would you have any update on PR#65120 , I don't think it was released in 2017.0 . Do you think its on the radar for 2017.1
Thanks
+55- Safer
ciarab wrote:
@Mark2AtSafe
Would you have any update on PR#65120 , I don't think it was released in 2017.0 . Do you think its on the radar for 2017.1
Thanks
+9- Contributor
mark2atsafe wrote:
Yes, that PR is targeted for 2017.1 and it has a very high priority. So - while I can't guarantee anything - it does look very likely.
Thanks @Mark2AtSafe I will keep an eye out for it
+26- Supporter
mark2atsafe wrote:
Yes, that PR is targeted for 2017.1 and it has a very high priority. So - while I can't guarantee anything - it does look very likely.
Thanks!
+55- Safer
- Best Answer
Looks like build 17475 is the one to use. It has the most recent fixes. See safe.com/beta for the newest betas. The functionality has been checked and verified by the quality team.
@runneals - I don't see any documentation, but according to the notes I have seen there is a new parameter on each reader feature type. It's called 'Include Attachments' and defaults to No (in case you're wondering, it's quicker and more backwards compatible to not default to yes).
So, if you set that, it should return features with the following format attributes:
New format attributes on all features:
- arcgisonline_objectid (always)
- arcgisonline_globalid (when globalids present)
New format attributes for attachments, present on features that have attachment(s):
- arcgisonline_attachment{}.id
- arcgisonline_attachment{}.globalid
- arcgisonline_attachment{}.size
- arcgisonline_attachment{}.name
- arcgisonline_attachment{}.content_type
- arcgisonline_attachment{}.data
So it looks to me like the attachment will be in the form of a data attribute, which you could then write to an output file using the AttributeFileWriter transformer.
Let me know if this doesn't help and I can investigate further,
Regards
Mark
FME Evangelist to the Rich and Famous!!
1 person upvoted this
+26- Supporter
mark2atsafe wrote:
Looks like build 17475 is the one to use. It has the most recent fixes. See safe.com/beta for the newest betas. The functionality has been checked and verified by the quality team.
@runneals - I don't see any documentation, but according to the notes I have seen there is a new parameter on each reader feature type. It's called 'Include Attachments' and defaults to No (in case you're wondering, it's quicker and more backwards compatible to not default to yes).
So, if you set that, it should return features with the following format attributes:
New format attributes on all features:
- arcgisonline_objectid (always)
- arcgisonline_globalid (when globalids present)
New format attributes for attachments, present on features that have attachment(s):
- arcgisonline_attachment{}.id
- arcgisonline_attachment{}.globalid
- arcgisonline_attachment{}.size
- arcgisonline_attachment{}.name
- arcgisonline_attachment{}.content_type
- arcgisonline_attachment{}.data
So it looks to me like the attachment will be in the form of a data attribute, which you could then write to an output file using the AttributeFileWriter transformer.
Let me know if this doesn't help and I can investigate further,
Regards
Mark
+1- Contributor
mark2atsafe wrote:
Looks like build 17475 is the one to use. It has the most recent fixes. See safe.com/beta for the newest betas. The functionality has been checked and verified by the quality team.
@runneals - I don't see any documentation, but according to the notes I have seen there is a new parameter on each reader feature type. It's called 'Include Attachments' and defaults to No (in case you're wondering, it's quicker and more backwards compatible to not default to yes).
So, if you set that, it should return features with the following format attributes:
New format attributes on all features:
- arcgisonline_objectid (always)
- arcgisonline_globalid (when globalids present)
New format attributes for attachments, present on features that have attachment(s):
- arcgisonline_attachment{}.id
- arcgisonline_attachment{}.globalid
- arcgisonline_attachment{}.size
- arcgisonline_attachment{}.name
- arcgisonline_attachment{}.content_type
- arcgisonline_attachment{}.data
So it looks to me like the attachment will be in the form of a data attribute, which you could then write to an output file using the AttributeFileWriter transformer.
Let me know if this doesn't help and I can investigate further,
Regards
Mark
I could use a little help... I think I have all the pieces to the puzzle but.... file folder is empty....hmmm???
Jeff N
runneals wrote:
@Mark2AtSafe Is there any documentation on this? I tried using it in the beta build, but couldn't seem to read any attachments that I had attached to one.
Thanks!
+22- Enthusiast
I agree, a template workbench would be cool. I'm not sure how to grab the attachment.
Hi - I have 2017.1 beta version. I have an AGOL feature service which has attachments. I would like to set up an FME job that can extract and save these attachments - is this possible?
I have ticked on include attachments as outlined above but can you advise what I do next to save the attachments which could be documents or images.
Many thanks
Caroline
+12- Safer
cfhogan wrote:
Hi - I have 2017.1 beta version. I have an AGOL feature service which has attachments. I would like to set up an FME job that can extract and save these attachments - is this possible?
I have ticked on include attachments as outlined above but can you advise what I do next to save the attachments which could be documents or images.
Many thanks
Caroline
+22- Enthusiast
lauraatsafe wrote:
Hi @cfhogan, If you attach an Inspector transformer to your AGOL reader, do you see the arcgisonline_attachment{} attributes listed when you check the Feature Information Window? If they aren't there, you may need to expose those format attributes on the Reader feature type before you can work with them. Once they are exposed, you should be able to use a transformer like the AttributeFileWriter to save the attachment files.
Someone told me about the RasterReplacer though and it works great! You need arcgisonline_attachment{}.data of course. You attach a Writer to this and that's it!
cfhogan wrote:
Hi - I have 2017.1 beta version. I have an AGOL feature service which has attachments. I would like to set up an FME job that can extract and save these attachments - is this possible?
I have ticked on include attachments as outlined above but can you advise what I do next to save the attachments which could be documents or images.
Many thanks
Caroline
Would it be possible to get some screengrabs of the attributefilewriter . Each record could have different type of file attachment e.g. word doc and a jpg. I've tried using the list option but I can't get it to work. Thanks. Caroline.
philippeb wrote:
I tried the AttributeFileWriter but it only creates a file with all the text coded in it. Not the solution I'm looking for.
Someone told me about the RasterReplacer though and it works great! You need arcgisonline_attachment{}.data of course. You attach a Writer to this and that's it!
I have an AGOL service with attachments and want to copy that data to a SDE feature class with attachments. Getting the points across is no problem, but I'm struggling with breaking out hte attachments and sending them to the SDE attachments table and dealing with the relationship class etc. Has anyone done similar work?
slamon wrote:
I have an AGOL service with attachments and want to copy that data to a SDE feature class with attachments. Getting the points across is no problem, but I'm struggling with breaking out hte attachments and sending them to the SDE attachments table and dealing with the relationship class etc. Has anyone done similar work?
I was able to use the explanations, the additional post links, and a provided sample workspace to build my own workspace in which I read my features w/attachments from AGOL and then rebuild those attachments to point features through the relationship class in a file geodatabase. I would think doing so in SDE should be very similar. In the end, you are writing to 3 targets: The point feature class as it sounds like you are doing now, the attachment file itself into an attribute in the __ATTACH object class, and then the relationship class record in __ATTACHREL to tie the two together.
- Add AGOL Reader, include the specific layer that has attachments and expose all related Attachment attributes (i.e. arcgisonline_attachment{}.content_type).
- Enure that Feature Types>Parameters>Format>Include Attachments is set to Yes.
- Add RasterReplacer transformer and set Blob Attribute: arcgisonline_attachment{0}.data
- Add Writer to the format you require, and set the Raster File Name: arcgisonline_attachment[0].name
Voila, you'll see your attachments in an output directory as configured.
I used FME build 2019.1
Is there another transformer I need to use to expose the attachment attributes? I've set the 'Include Attachments' of my reader to 'Yes' but the attachment attributes don't show in the attributes. When I tried using the Inspector, I could see that the attributes are there..
+13- Safer
poalgura wrote:
Is there another transformer I need to use to expose the attachment attributes? I've set the 'Include Attachments' of my reader to 'Yes' but the attachment attributes don't show in the attributes. When I tried using the Inspector, I could see that the attributes are there..
Hi @poalgura,
After setting the Include Attachments parameter to 'Yes" you will want to expose the arcgisonline_attachment{} Format Attributes by going to the Format Attributes tab and exposing each one.
danminneyatsaf wrote:
Hi @poalgura,
After setting the Include Attachments parameter to 'Yes" you will want to expose the arcgisonline_attachment{} Format Attributes by going to the Format Attributes tab and exposing each one.
Thanks, @danminneyatsaf !
Are you familiar with this workflow too? I tried following the steps written by @magnust66 but i run into an issue with the RasterReplacer, "INVALID_FEATURE_CANNOT_READ_BLOB". Any idea how to resolve this one?
To expose the attachment attributes, you can use the AttributeExposer transformer, or right-click on the AGOL Reader, and access the Format Attributes tab to also expose the hidden attributes.
+13- Contributor
Happy Friday FMEers, Just wanted to share some knowledge on this old school topic….. We noticed after upgrading to 2025.1 that the arcgisonline_attachement().data (using the old first class now depreciated way to get attachments) is throwing an error: “transcoding the binary string to another encoding can not be done”. The simple workaround I found is to put an AttributeManager on arcgisonline_attachement().data to force it to be binaryBuffer and not String.
Hope this helps. Best Reed
Helpful Members This Week
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.