Using readers and writers to extract and load data.
Recently active
I am trying to read data from an ArcGIS Server Feature Service and am running into an issue with FME accepting the token. When I enter the Service URL into the parameters dialog, put the token in the token field and then test the connection by clicking the button to view the layers list I get an error that tells me it's an invalid token.To access the feature service I have to log into a website using a username and password. From there I have to cut a token to connect to allow FME to authenticate to the ArcGIS Server service. I have no way of validating that the token I generated is correct but I followed the steps outlined in the following ESRI support document so I assume it is correct: http://server.arcgis.com/en/server/10.3/administer...The one suspicious piece of the puzzle is that my token seems to be truncated somewhat. Maybe its standard but each token I've generated ends in "..". This just does not seem right and I was hoping that maybe someone has experience
ESRI has a Runtime Geodatabase used by Collector for ArcGIS. The file has a .geodatabase extension when downloaded from an iPad or Android tablet. In reality it is a SQLite database. I can query it with SQLite Studio 3.0.6, but not read it with FME 2018.1.
I have a shape file with feature class polygon and want to convert them into an osm file. I've verified the polygons by several transformers in workspace. The result is always an osm file with lines instead of polygons (FME Inspector)???
I am designing a workflow that will streamline our our 911 data to ESRI ArcPortal as well as a local geodatabase. the information fed in is from a SQL server and represents specific apparatus information as related to a particular call, and runs through some calculations for things like response time, time on call, etc.. I've gotten to the point where the data splits off in 2 streams one for apparatus data and another for unique call data compiled by merging apparatus information and aggregating the data by the Call Report number. Everything works fine to this point.The initial run of this yielded over 600,000 features to be written since a dataset of call information didn't exist prior this was expected. This initial dataset was then uploaded to our portal service since the Portal writer appears to only insert, update or delete. I run the script daily to pull the previous days call information and when it got to the point that the data was going to be pushed to our portal I g
I know that there is a writer that writes, updates or replaces data in availible layers. Is it possible to write multipatch also? Second question; is it possible to create new layers in AGOL from FME?
Hello FME Community, I have a workspace running smoothly on FME Desktop, but as soon as I launch the workspace on FME Server, I'm confronted with an error message like this: The workspace reads some data from different sources, performs some hocus pocus and finally writes to autocad format. I've replaced the Autocad writer with a simple .txt writer, to ensure the problem is not situated at the writer.The FME Server account has writing permissions to the folder location I'm trying to populate with some data.Since I'm creating a new Autocad-file, I'm quite confused with this error message. The file is generated by my workspace, so it can't be opened in another program.What can be causing this error ?Has anyone experienced this error before ?Kind regards, Dries
Is it possible to delete an entiere sheet in a Excel document? While a writer allows me to delete input in a certain sheet, I can't find a way to delete a whole sheet. Thank you,
I have a general question about the way FME is able to read data. Right now I have data stored on a fileserver, which I want to read into FME directly.What would happen if someone else is accessing this data, either directly or through another application, while I was reading the data into FME? Would this cause an error in FME? Or could simultaneously reading the data from the fileserver, while someone else is accessing or probably editing this data in another apllication have a negative effect on the performance in the other application?Now, I just copy the files from the fileserver each time I want to read them all. However, I'm trying to find out if this is really neccesary or if I can just load them directly without causing other problems.
Which fme attribute data type to use in the schema definition file, that dynamic writer will be using to output the ms access tables? When I am using fme_char(65,536 ) and fme_varchar(65,536), workspace truncates fields to 255 characters...
Hello, I am trying to get data from a IFC File into a Postgresql Database. Preferentially I would like to work with a java code which reads the IFC File and writes the attributes in a Database similar to the ODBC Export from Revit. But I am not able to do that. Does anybody have any suggestions? Thank you in advance.@daveatsafe
Hi,When I´m trying to read a layer using the ArcGIS Feature reader it´s resulting in the following error:Creating reader for format: Esri ArcGIS Server Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\\apps\\FMEBeta\\plugins/python27\\arcgisonlinefeatures\\__init__.pyc'Python Exception <ImportError>: No module named parserCould not create Python Reader `ARCGISFEATURES'A fatal error has occurred. Check the logfile above for detailsThe weird thing is that in the scripting parameter the Python compatibility is set to Python 3.4+ but still it´s using the Python 2.7 plugin?I´m using the latest build (20170517 Build 17494).Christian
Hi, Looking to create a 3d sphere from the XYZ coordinates in the attached CSV and then add the "Filename" property to each sphere. Can someone help? Ive tried the Hub3DBufferer, but I cant get the geometry created. Happy with an AutoCAD or similar output. CSV file attached if anyone can help me
Hi FME experts,I have stored polygon objects in an Oracle database. The geometry is in the GEOM field. For an interface, I have to convert the GEOM field into a text field. The GEOM field looks like this:select geom from VIEW_RIWE_2016_BORIS where fid = 70118sdo_geometry(2003,25832,null,sdo_elem_info_array(1,1003,1),sdo_ordinate_array(510843.904449149,5369878.15541307,510782.847025386,5369803.95356616,510757.074323074,5369773.29550141,510804.270134531,5369734.73477362,510819.559582734,5369752.69084497,510863.309430839,5369806.93171413,510890.267651986,5369838.63447086,510843.904449149,5369878.15541307)) The TEXT field must later look like this:POLYGON ((32563549.456 5934230.837,32563553.002 5934219.989,32563552.58 5934219.778,32563542.348 5934220.82,32563537.637 5934221.725,32563533.431 5934221.663,32563522.282 5934224.668,32563543.799 5934230.72,32563549.027 5934230.188,32563549.456 5934230.837))With a bit of text editing, I could easily edit the field. My problem now is that the SQL
Hello, I was asked by a colleague if I we can use FME to create a report with 3D Thumbnails like this:And I'm not sure? Is there a way?I guess I would have to create the thumbnails externaly and join it back together to create a pdf?
HiI am clipping a LAS file and writing to a new LAS file. I have noticed in the LAS Header the following fields have not been updated and contain info from the original LAS file:system identifier generating software file creation day/yearWhen I clip using lasclip these fields are updated so I wondered if there is a reason FME doesn't?TIA
I have approximately 170 tables from a sqlite database that I need to convert to geojson and save as @Value(fme_feature_type). I have a workflow to process each table individually but I need a way to automate the process. Passing all tables through the same workflow merges the schemas of all input tables. It isn't practical to pass each table through its own set of transformers when dealing with this amount of tables. Some type of loop control seems logical to pass tables through the workflow one after another while ensuring that output schemas are refreshed after each iteration. I'm fairly new to FME so any help would be truly appreciated.
I received a sample of IFC data and was asked to import it into MS SQL database spatial database.I was able to import the data but no geometry. How do I get the geometry? This is new data for me. @DaveAtSafe
Hi there,Probably a fairly simple one for you, but I'm a total novice!I have hundreds of thousands of files in PDF and TIF formats hosted on a server - lets call it Server 1.In a SQL2008 database on another server called Server 2, I have over 100000 records which contain a specific reference number which links these files individually (so that one reference number might be linked to several PDFs or TIFs using the same reference number, e.g. Ref number 19994321 on Server 2 will be related to PDFs/ TIFs with the Ref number 19994321 on Server 1).In an Excel spreadsheet, I have a list of the reference numbers on Server 2 that I want to retrieve files for from Server 1 and I need to call them using two field names in the SQL database which defines the PDF/ TIF- under either 'Subject_Name' or 'doc_Type' and containing certain words as a parameter to narrow the search: 'Site Location Map' and/ or 'Location'.I want to then copy those files (once identified f
Hello. I'm currently trying to figure out a way to extract 3D layers from a project I have online. I'm able to extract the parent layers, but I'm having trouble trying to get attributes from the child layers. I'm using a JSONFeature Reader, ListExploder, and a FeatureReader, but perhaps my parameters aren't correct. If anyone has any suggestions on a workflow, I'd appreciate it. Thanks!
I have a workspace that I can run on my desktop 2018.1.2.0 however when I run it on server it returns the below error. I am running WIN Server 2016 with FME Server 2018.1.1.1 build 18578. The class 'COM/safe/fmewebservices/FMENamedConnectionEnv" could not be located. Check your classpathError getting id for 'COM/safe/fmewebservices/FMENamedConnectionEnv' with signature 'COM/safe/fmewebservices/FMENamedConnectionEnv' From the reference below I copied all of the main window into a new workspace and it worked temporaily. https://knowledge.safe.com/questions/60124/the-class-comsafefmewebservicesfmenamedconnectione.html
log.txtMy writer into an esri fgdb is failing.An error occurred while attempting to store a row into the table 'PriOHElectricLineSegment'. The error number from ArcObjects is: '-2147221230'. The error message from ArcObjects is: {} The error message of "{}" is not very helpful. I attempted to look it up with esri without any luck.Does anyone know the source of the problem?Thanks
I have an Excel spreadsheet where I want to pass several attributes as variables into a SQL Query using a SQL Creator transformer. What is the best way to achieve this? I don't see how I can make the attributes as user parameters.
I am getting "Python Exception <KeyError>: u'token'A fatal error has occurred. Check the logfile above for detailsFailed to obtain any schemas from reader 'ARCGISPORTALFEATURES' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationUniversalReader -- readSchema resulted in 0 schema features being returnedReader Parameter(0) = >https://gisgateway.williams.com/portal<Reader Parameter(1) = >RETRIEVE_ALL_FS_NAMES<Reader Parameter(2) = >Yes<Reader Parameter(3) = >AUTH_TYPE<Reader Parameter(4) = >generate_token<Reader Parameter(5) = >USER<Reader Parameter(6) = >ckeating2<Reader Parameter(7) = >PASSWORD<Reader Parameter(8) = >********<Reader Parameter(9) = >_MERGE_SCHEMAS<Reader Parameter(10) = >YES<Reader Directive(0) = >RUNTIME_MACROS<Reader Directive(1) = >RETRIEVE_ALL_FS_NAMES,
Hi all,We have FME server on linux using docker; FME Server 2017.1.1 - Build 17650 - linux-x64.Unfortunately we found out that some processes are generating core dumps and hss_err_pidxxxx.log files.Does somebody know, what could be root of the issue or where should we start to find out the root of the issue? Also how to identify what process exactly is causing generation for core dump and hs_err_pidxxx.log creation?thanks a lot in advance!information from hs_err_pid153.log file:# # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007f6469201630, pid=153, tid=0x00007f644203c700 # # JRE version: OpenJDK Runtime Environment (8.0_131-b11) (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11) # Java VM: OpenJDK 64-Bit Server VM (25.131-b11 mixed mode linux-amd64 compressed oops) # Problematic frame: # C [libfmeutil_jni.so+0x12630] JNIEnvGetterManager::GetCurrentThreadJNIEnv()+0xe0 # # Core dump written. Default location: /data/fmeserverdata/reposit
I need to use the elasticsearch writer with authentication - works great in Beta but I need to get it into production with both desktop and server.It would be great if I could some timescales so that I can feed back to the project team