Skip to main content
Open

Support bulk appends when the ArcGIS Python API becomes available

Related products:Integrations
debbiatsafe
siennaatsafe
LizAtSafe
danilo_fme
runneals
+15
  • debbiatsafe
    debbiatsafe
  • siennaatsafe
    siennaatsafe
  • LizAtSafe
    LizAtSafe
  • danilo_fme
    danilo_fme
  • runneals
    runneals
  • bruceharold
    bruceharold
  • chriswilson
    chriswilson
  • sam_a
    sam_a
  • aarcra
  • cjd111
    cjd111
  • erooen
  • esietinga
    esietinga
  • oshkosh_gis
  • xilef
    xilef
  • qmarquette
  • geoportalcartog
    geoportalcartog
  • krlem
    krlem
  • divya
  • gautmaricwl
  • laurawatsafe
    laurawatsafe

LizAtSafe
Safer

Support bulk appends when the ArcGIS Python API is available, with and without truncate.


See the question Writing LARGE datasets to ArcGIS Online for backstory and other information


6 replies

bruceharold
Contributor
Forum|alt.badge.img+17
  • Contributor
  • May 15, 2019

I think the Python API is a pure python module you can just install:

https://developers.arcgis.com/python/guide/install-and-set-up/

 


runneals
Contributor
Forum|alt.badge.img+19
  • Contributor
  • May 22, 2019

Support this method in both Portal and ArcGIS Online.


runneals
Contributor
Forum|alt.badge.img+19
  • Contributor
  • June 14, 2019

@carsonlam when developing this functionality, there needs to be either 1) A search performed prior to writing the fgdb to AGOL that searches for file geodatabase items with the file geodatabase name and if found deletes it, or 2) Use a unique name for the file geodatabase/zip (I appended the Job ID, which may not work for desktop users).

The biggest issue that I've come across with my script so far is that if the python script doesn't complete, the file geodatabase item could be orphaned, and won't upload the item since the item already exists. This should be tested in QA/QC!

Also another thing regarding this idea that I have found is that the traditional insert via applyEdits works faster in some instances (when writing a small number of records to AGOL), so that should still be the default and maybe this could work with a checkbox type thing? Or maybe even a new "bulk" writer.


runneals
Contributor
Forum|alt.badge.img+19
  • Contributor
  • June 14, 2019

For those following this idea, I was able to get it implemented (in a hack fashion). Check out the question for the fmw workspace.


runneals
Contributor
Forum|alt.badge.img+19
  • Contributor
  • July 22, 2021

Can this be implemented in the ArcGIS Online Connector?


bruceharold
Contributor
Forum|alt.badge.img+17
  • Contributor
  • April 11, 2022

Append is available via REST now so it can be a writer mode:

 

https://developers.arcgis.com/rest/services-reference/enterprise/append-feature-service-layer-.htm

 

Example usage:

 

https://community.esri.com/t5/arcgis-data-interoperability-blog/building-a-data-driven-organization-part-9-load/ba-p/1125830

 

Deletes aren't supported so they will have to be done via applyEdits but deletes are quite performant.


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings