Skip to main content
Open

Support bulk appends when the ArcGIS Python API becomes available

Related products:Integrations

LizAtSafe
Safer

Support bulk appends when the ArcGIS Python API is available, with and without truncate.


See the question Writing LARGE datasets to ArcGIS Online for backstory and other information


6 replies

bruceharold
Contributor
Forum|alt.badge.img+17
  • Contributor
  • May 15, 2019

I think the Python API is a pure python module you can just install:

https://developers.arcgis.com/python/guide/install-and-set-up/

 


runneals
Contributor
Forum|alt.badge.img+19
  • Contributor
  • May 22, 2019

Support this method in both Portal and ArcGIS Online.


runneals
Contributor
Forum|alt.badge.img+19
  • Contributor
  • June 14, 2019

@carsonlam when developing this functionality, there needs to be either 1) A search performed prior to writing the fgdb to AGOL that searches for file geodatabase items with the file geodatabase name and if found deletes it, or 2) Use a unique name for the file geodatabase/zip (I appended the Job ID, which may not work for desktop users).

The biggest issue that I've come across with my script so far is that if the python script doesn't complete, the file geodatabase item could be orphaned, and won't upload the item since the item already exists. This should be tested in QA/QC!

Also another thing regarding this idea that I have found is that the traditional insert via applyEdits works faster in some instances (when writing a small number of records to AGOL), so that should still be the default and maybe this could work with a checkbox type thing? Or maybe even a new "bulk" writer.


runneals
Contributor
Forum|alt.badge.img+19
  • Contributor
  • June 14, 2019

For those following this idea, I was able to get it implemented (in a hack fashion). Check out the question for the fmw workspace.


runneals
Contributor
Forum|alt.badge.img+19
  • Contributor
  • July 22, 2021

Can this be implemented in the ArcGIS Online Connector?


bruceharold
Contributor
Forum|alt.badge.img+17
  • Contributor
  • April 11, 2022

Append is available via REST now so it can be a writer mode:

 

https://developers.arcgis.com/rest/services-reference/enterprise/append-feature-service-layer-.htm

 

Example usage:

 

https://community.esri.com/t5/arcgis-data-interoperability-blog/building-a-data-driven-organization-part-9-load/ba-p/1125830

 

Deletes aren't supported so they will have to be done via applyEdits but deletes are quite performant.


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings