Using readers and writers to extract and load data.
Recently active
We noticed that the speed of data writing to the DGN format depends on the type of objects. If we set the cell object at the beginning the writing was fast, then at the end, the speed slowed down several times. And the question is, is it a writer's trait or an object's trait?
Hi, we have a citygml file that contains a bridge. The validation by "citydoctor " showed no errors. Now we wanna extract the geometry. FME can read the file without error. But only a core element is shown and I cannot get the geometry!By the way we got the same result with the template bridge from the university (KIT)! Does anyone have any ideas or tipps for me?Thanks in advance.
I am trying to add an ArcGIS Server Feature Service reader to my workspace. I just need one of the layers from the service. Several of the layers have the same name but are differentiated by their parent layer (which are scale dependencies). FME Desktop Help claims it shouldn't be a problem, stating "The reader resolves ambiguity by appending the layer ID to the end of feature types if multiple layers share the same name. If a layer ID is present in the feature type, the ID takes precedence over the name." That doesn't appear to be happening because I receive the following when I select my desired layer and try to add it: "ArcGIS Feature Service Reader: Found multiple layers/tables that match the feature type 'Stations, PNM (4)'. They are: 'Stations (4), Stations (10), Stations (16), Stations (22), Stations (28), Stations (34), Stations (40)'. Resolve the ambiguity by specifying the layer/table ID in the feature type." Ok, but how? I do so in
I would like to insert to a Postgres table where ther is set up an trigger event with hstore function to write to another table. While running in common SQL client with "public" search_path, there is no problem.I can't make it run in FME workspace, always getting an error:ERROR: function hstore(vfk.par) does not existwhere "vfk.par" is the table I'm writing to. I have tried to add search_path "public" setup in "SQL To Run Before Write" but with no luck. Any hints, please?-------EDIT: In another workspace with another schemas but with similar tasks it runs without errors as expected. The triggers with its functions are almost identical.
I renamed a hosted feature service in ArcGIS Online and now need to update the name in a few FME workspaces (FME Desktop 2020.1.2.1 - Build 20624). But how? The feature service path is not editable under Parameters and neither Update nor Import Feature Types accomplishes the task from what I can see. It looks like I can do so using Find and Replace in a text editor but I'm not entirely comfortable with that solution. Is there a standard method I'm overlooking? And yes, I will be replacing the feature service name with the item id moving forward so this is no longer an issue. 🙂
Hi All, I was wondering if its possible to retrieve attachments from one feature service in portal and insert them into another table within a different feature service in portal. I am able to read the attachments however i dont understand how to write these attachments back to another table without using the arcpy interpreters.
Hello I’m new to FME. How do you rename a source_file (MapInfo.Tab) and copy it to another folder using a Filecopy writer? I've seen similar questions to this but I still don't know how to do it. I managed to replicate the Filecopy following the instructions here: https://knowledge.safe.com/articles/How_To/Including-files-dynamically-in-a-data-download-result .However, I want to rename my MapInfo tab file (which I am copying with the Filecopy) and I’m not able to do this. This is what my process looks like: The source table is named Car_Parking.Tab and I want it to be CARPARKING.Tab in the output folder. Landmark is copying fine and I don’t need to change the name. These two are part of a bigger workbench which copies many files. For now Car_Parking.* is copying as Car_Parking.* to my output. I did try various things -changing the _filename_part in an attributecreator, Fanout options (I managed to create a CARPARKING folder )- Creating a Path and file name reader... etc-
Hi when I reproject dwg file from NAD27_MTM_zone_10 to NAD_1983_CSRS_MTM_10 using Csmapreprojector, it reprojects all elements of DWG files execpts Arcs. is there any setting that handle this issue?
Example: First user parameter is choice type with values is Provinces (Ha Noi, TP.HCM, Da Nang...)Secondary user parameter is also choice type with values is Districts (Hai Ba Trung, Dong Da, Ba Dinh,...)I select User Parameter 1 with a province and it'll filter and just show choice are districts of this provinceIf you know how to solve let's show me! Many thank!
The folder that should be containing the .fmeks file has .jceks files. Everything was working correctly before I upgraded to ArcMap 10.8.1. Error message is attached.
Is there a possibility to suppress annoying WARN messages of the 'Autodesk AutoCAD RealDWG DWG/DXF' FeatureReader? Please see the following example:I use the AutoCAD reader to read features from an DWG file. I am only interested in the features of one specific layer (specified by a user parameter):Hence, the AutoCAD reader reads the file and skips all layers but the specified one. In the log, the reader starts writing which layers are skipped. These messages are written at 'Information' level. After writing the 10th skip message, it writes a message "Further instances of this message will be suppressed" on WARN level. -----As text:2023-03-23 14:17:38| 1.8| 0.0|INFORM|AutoCAD Reader: Successfully opened the 'Release2018' AutoCAD file '<SOME_PATH>'2023-03-23 14:17:38| 1.9| 0.1|INFORM|AutoCAD Reader: Features for feature type '0' will be skipped based on the feature types requested2023-03-23 14:17:38| 1.9| 0.0|INFORM|AutoCAD Read
I am getting the following error when I use the ArcGIS Online Feature Service Writer: "ArcGIS Online Feature Service Writer: Multiple Global IDs defined for feature type 'd_y_n'. This is not permitted." I am trying to copy the data from one ArcGIS Online (AGOL) hosted feature layer to another hosted feature layer with the identical schema. The source is a view-only feature layer, and the target is an editable, blank duplicate of the source. The target has hasVersionData=false and supportsApplyEditsWithGlobalIDs=true. All layers with attachments have global IDs defined and all attachment relationships are defined to use GlobalIDs as keys. In the Writer parameters, I have tried Use Global IDs=No and also UseGlobal IDs=Yes and Preserve Global IDs=Yes. I still get the same error with either of these cases. What might be going on here? I can't say I really know what the error is getting at. Might the problem be that there is at least one table that is related to two ot
Hi, I want to update an ArcGIS Online hosted feature service which has read-only 'Editor' and 'Creator' Fields. Has anyone been able to update read only fields on ArcGIS Online? Thanks
I have a distributed FME Server deployment (core + n Engines). One of the Engine hosts has been dedicated to run jobs that require to write/read to/from Esri Geodatabase (SDE). In order to enable that I deployed ArcGIS Server on that machine (it is licensed and running).Unfortunately when running a job that tries to read from SDE (Oracle) I got the following error:60 Creating reader for format: Esri Geodatabase (ArcSDE Geodb)61 Trying to find a DYNAMIC plugin for reader named `GEODATABASE_SDE'62 Could not load module '/opt/fme-engine-2022/plugins/..\geodatabase9.so' : '/opt/fme-engine-2022/plugins/..\geodatabase9.so: cannot open shared object file: No such file or directory'63 Module '..\geodatabase9' is unavailable for use with this FME editionIs this configuration (access to SDE GDB from Linux machine) supported? Should I try to use Windows based Engine machine with ArcGIS Server? FME Server version: FME Server 2022.2.4, Build 22792 - linux-x64ArcGIS Server: 11.0 Advanced
I have a Group in my company ArcGIS Online (AGOL) that holds multiple, shared, hosted feature layers, each based on a feature service and having multiple layers both spatial and non-spatial. As such, each hosted feature layer is a Feature Layer Collection in Esri-speak. Many of the non-spatial layers in a hosted feature layer are attachment tables, so others are relationship tables. I need to read the schemas (as schema features) of every layer in every hosted feature layer into one big stream. Alternatively, I could read all the features and shove them through a SchemaScanner. In either case, I need FME entities, and I need to be able to loop through all the hosted feature layers. Because FME FeatureReaders for AGOL Feature Services can process only one feature service at a time, I can't process all the hosted feature layers in the same workspace run. I can think of a way to use multiple worksapces and WorkspaceRunner s to do the required looping, but that is kludgy and complex
How to extract photo attachments from an fgdb esri file?
Hello, I have a table which needs to be written to PostGIS. One of my dataset columns contains a list of buffer distances for example 300, 200, 100m. It would be ideal to write this as an array to PostGIS for example {300, 200, 100}. If the table already exists with an array column in PostGIS, FME will update the array correctly. If the table doesn't exist I can't see how to set the column type as an array in FME. Is it possible? Thanks :)
I'm looking for a way to upload to an azure file storage with a new filename. I eventually want to expose an FME server app that will allow the user to upload any raster file, and then will upload that file to the Azure Storage and call a few REST APIs afterwards. I have a basic workbench working on my machine that can implement the workflow. The issue is, we can't have any spaces or periods in the filenames in the Azure storage, but I want to allow the user to upload rasters without changing the name. I have not found a way to be able to rename the file before or during the upload. I have experimented with using a Feature writer transformer with the File Copy writer to create a temporary file then using the temp file path in the Azure File Storage Connector but I'm struggling to even rename copies there. I realize I could probably do hacky stuff like use a systemcaller to rename the file, but if I need to do that I'm not sure what the advantage of using FME is, since
Is FME version 2021 able to work with ESRI Geodatabases in ArcGIS 9.0 and 9.3 formats?
Hi everyone, I'm currently looking to use the Ressource or Network Directory trigger on FME Server automation to trigger a workbench when new file are added to a file. The file type is DWG. With a DWG file, there is 3 other file that are attached to this file. How can I specify to the directory watcher to only look for new DWG file and not the attached file. Right now, my workspace is launch 4 time because of it. Thank you in advance, Ian
Hi,When we try to convert dgn file issued from teigha in FME software, we have troubles with OdDgCellHeader2d cell name.it seems to be an encoding trouble. Teigha used UTF8 encoding and FME try to read an ansi string. Note that there is no trouble with the string linkage of the cell.We have post on the teigha forum and aidan.wessel have answer.We join a dgn file with two ERPTRL Cell, one dropped with teigha library and the other with microstation.inside microstation, we have no trouble. FME is not able de read igds_cell_name for the one dropped by teigha library.thanks for your answer,best regards,G. COSTAMAGNA
Hello,When use Obj Reader,materials aren't appearing properly. .mtl does not refer to additional image resources. Attachment is my obj file.Thanks
Hello.When I loaded the ifc file, I noticed that the position of the text was wrong.The image below is the Inspector View when reading FKZ Haus data (*1) (*2).*1) https://www.ifcwiki.org/index.php?title=KIT_IFC_Examples*2) I specified "Industry Foundation Class STEP/ XML Files (IFC)" as the format. On the other hand, the image below shows the same data displayed with FKZViewer.(I hide everything except IfcAnnotation to make it easier to see) What is the reason for this misalignment? Also, are there any workarounds?
Hello I would like to truncate and write data to a feature layer on arcgis portal.I'm getting the following error and I don't know what's wrong with the workbench.
Hi, In my workspace I work with coordinates in different projections. I store them as numeric values. E.G. Geolat: 52.0324234. I want to write this to a PostgreSql database, which has the same type as is required for the value. Seems all good. But. When I start writing I get an error where it complaining about the input syntax is not of type 'numeric'. I see a query inside the log, Where it changes the value 5.2023617 from Longitude to " E'5.2023617' ". Which is a string. Which I dont require. Does anybody know where to look at or how to solve it?