Using readers and writers to extract and load data.
Recently active
I am looking for a help, How to import arcpy module in FME Server. How we need to call arcpy module using python in FME Server, also what are the files folders need to upload in FME Server to run arcpy code. Please can guide step by step instructions. Thanks in AdvanceVenu
Hi,I'm looking to produce a map which visualizes polygons based on an attribute value (e.g, population) and scales them high to low or low to high. Using FeatureColorSetter i can apply a random colour to each area based on an attribute, but i would like to apply a colour scale. For example, going from a dark red (highest population) to light green (lowest population). Is this something that can be done, without having to use a styling transformer for each different attribute?Thanks
Hi,I´m record data from DWG files, but there is some versions of the same file...for example: V1, V2, V3...What the best way for extract the more recent version by file? I need to create one field called last_date? How I can to extract the last date for example?Thank´s
Hi, I am new user in FME. I have build a workspace that informs as in the drawing below, if the farm is illegible or eligible, based on some socio-environmental criteria of my country. In this table must be updated daily, what only changes in it is if the farm is eligible or ineligible in the status field. Here I need to make a simple update. Look belowThe problem is that this is not the only table I need to update, I need to also update another table, which describes in more detail the reason for the Inegibility or eligibility. However I have to be very careful with the code so I do not qualify the wrong farm. The table that I show below, is the second table and notice that the field analyze_code is equal to the code of the first table. How can I do to update the first table according to the code that already exists and then use the code of the first one to update the criteria of the second table using the FME?Can you help me? Was I clear on my question? I need to make this wor
1- workspace 2- the feature class schema 3- transforming the attributes with test filter and attribute manager 4- the result is the same schema .. without any change 5- the result from the transformer (inspector)
I am trying to translate data from SHP to Smallworld EO. I am getting follwoing error. Please let me know if any one face this issue and how to resolve .:eo_structure_manager expects a preference value for 'eo_auto_attach' on an application service provider 'eo_options' from current_application 'unset'.Regards,Babu
Hi-I'd like to read the contents of a working Excel file in a 2013 Sharepoint document library - to transform and put elsewhere. I have success doing this using (licensed) FME Desktop/workbench 2016, but cannot automate the task with (demo) FME Server [or as a scheduled desktop task]. Is there an SSH limitation with FME between the command-line executable versus the workbench? Is there a proper way to map my Sharepoint library?Thanks in advance.~jake
I am looking into the possibilities to proces IFC_XML messages within FME. I found that the current IFC and Revit readers are not able to read IFC_XML files.One approach is to build a custom reader / transformer / workspace to interpret IFC_XML messages. I think it would be a lot of work to make a custom implementation of the IFC_XML standard in FME. Especially difficult to interpret the geometry of the objects.Another approach would be to use a third party tool (e.g. python library). But i am struggling to find something appropiate. I have only found xBIM Toolkit so far (which is .NET based). I am playing with the idea to see if I can use this tookit to create custom IFC_XML transformer in FME.I would like to hear from others who are experienced with using this format. How would or have you tackle(d) this?
Hi!I am at the moment struggling with reading Civil3D Files(created in Civil 3D 2017/older). I end up with a lot of strange looking Chambers/Structures & most of the Pipes end up as lines. Please see Pictures & attached Example File . The Designer in this case i using a Plugin called "Naviate", which is mostly used in Sweden(I think). These Pipe Networks are also modeled with a huge radius(Which is a bit uncommon I believe). Therefore I thought this could be the source of the problem, and tried creating test networks in a "plain" Civil 3D, to check if it´s due to the Designer/plugins/etc. However I end up with the same result. -------Any known bugs? -Possible to get a test Workspace + test File? -Any guidance on the Topic would be vary helpful.------I attended an inspiring presentation by Dale, showing a neat workflow to handle the Civil 3D Files & the object. Note sure if this was in the 2019.1 version, but as I understood, this should also be possible
I have an issue with a DatabaseUpdater command.It seems to initiate a SELECT * FROM MyTable before it does the update SQL command which is fine for one of my tables as I don't have masses of data so it completes quickly then carries on and does the updates. One of my tables however has millions of rows so doing a SELECT * on this is clearly never going to work and basically locks the table out and becomes unusable.Here is my flow so a csv input passes through a tester then calls to the DatabaseUpdaterSQL Trace:Does anyone know why it needs to do the SELECT * and how I stop it from doing it so my updates run?
Hi,I'm simply trying to convert a DWG to ESRI shapefile but the DWG has no spatial reference. I'm aware of the ability to add DWGs in ArcMap, however, the scale on the DWG file is exaggerated. Below is my FME tool that I setup per FME tutorial and still get the same results. The layer is spatially wrong size and location. When I run the inspector the CRS and units are unknown. What am I missing? Thanks!
I need to write features, coming from a WFS, into PostGIS (I'm using FME 2017.1 Build 17532).Requirements: 1. As the WFS delivers lots of feature types I want to do it dynamically (Dynamic Schema Definition) 2. I need to change table names to lowercase (not only attribute names) 3. I want to dynamically delete all attributes containing "gml_" or "xsi_nil" in their names. No. 2: I copy the format attribute fme_feature_type to a new attribute that I call lowercase_feature_type and change its case. The original fme_feature_type goes into "Schema Definition Name" (so that the writer finds the original schema from the reader), lowercase_feature_type goes into "Table Name". Problem: Apparently there's still a bug in the PostGIS writer so that in the dynamic case the "Table Qualifier" parameter is not respected at all. I solved this by concatenating the desired schema name to lowercase_feature_type separated by a point before assigning
Hi I have used JsonFragmenter to read a json file and have ended up with a set of attribute values plus a list of values for each feature. I need to write the list to single attributes in a table based on the index. (see attached)e.g Signalstatus[0] written to field STATUS_0Signalstatus[1] -> STATUS_1 e.tc.Any suggestion ?
Morning all, I am loading a set of shapefiles into a PostGIS database using a shapefile reader and a PostGIS writer. If I accept the default workbench created by FME the data gets written to the public schema. Where/how can I set the schema in the writer that I actually want the data written to? Probably a simple solution... FME Desktop 2012 sp3 and PostgreSQL 9.1 with PostGIS 2.0 Thanks
I converted a gml data to cesium 3d tiles.It got converted to cesium 3d tiles correctly but the data is getting an extra added height.The 3d tiles data is not getting aligning properly with the basemap.The 3d tiles data is in the air.What could be the reason.Please check the attachment image.The tile is in the air.
Hey all,I'm just recently working with FME. We are using fme for converting xyz pointclouds to geotiff format. Converting is not longer a problem (thanks to the fast help here).But now i'm looking how i can set a boundrie for the geotiff. (drawn in blue) As you will see in picture i have added here the geotiff also gives elevation where there is no data. (blue circle).I know that in C3D i can set a boundrie for the geotiff or give a max triangle length(witch is not the best solution but also works for this problem). Is there anything like that possible in FME? Many thanks,Koen
Hi,I'm trying to wirte to a SDE database with postgres arcitechture. I've filled in all the parameters and I get this error message: An error occurred while attempting to open the table, feature class or relationship class 'datasetname.featureclassname'. The error number from ArcObjects is: '-2147467263'. The error message from ArcObjects is: {}What a lovely error message from ArcObjects, right..Has anyone experienced this, and know what can be the fault?Ps: I couldn't find the error number here: http://resources.arcgis.com/en/help/arcobjects-java/api/arcobjects/constant-values.html
On the safe software site, I realize that there are only 64-bit FME products for Linux. I have a 32bit oracle database and obviously use a 32bit client. How will this linux FME enable the Oracle reader?
Hello FMErs,I am wanting to read a .log file from a specific directory, run it pass a tester on a specific attribute and then output the result in excel file format. I plan to place this on the server for self serve.example file attached. I had to change the file extension to .txt due to attach rules.suggestions?thanks in advance.
I'm calling a child Workspace using a WorkspaceRunner. The child Workspace says translation was successful as does the WorkspaceRunner, but when I reviewed the log for the child Workspace, I noticed there were warnings like this: "Provider error `(-2147217873) Violation of PRIMARY KEY constraint 'xxxx'. Cannot insert duplicate key in object 'yyyy'". If this happens, I want the Workspace to fail/terminate. Is there a way I can do this? Would a FeatureWriter transformer rather than a normal Writer give me this functionality?
Hi Community,After reading this article here, I felt I should tailor my question for my particular challenge and request help from @GerhardAtSafe and @stewartharper, (and if you could point me to the youtube videos and github repo mentioned there I'd be so grateful!) My question pertains to creating a similar process as the "FME Cloud API return ZIP file", but with a few variations in the workflow.What I want to do is call a varying number of CSV files, created as output from another set of FME workspaces executed on Cloud/server, into a workspace(s) which parses some media UUIDs from a couple columns in the CSV into a single line item list. This list of media UUIDs is then used to pull the media from an S3 bucket, and push to another S3 bucket. Now, this next steps is where it gets tricky in the workflow. * How can I enable to ZIP up all the media into one zipped file, give it a date_timestamp file name, such as update_03OCT2018_0830utc.zip, (or what ever may come from s
Hello,I have researched this topic quite a bit and have not been able to solve my issue. I am simply wanting read ArcGIS online feature service layers. I thought it might be a proxy issue, but confirmed with IT that the proxy is fine. I put in my credentials and then click on the ellipses for Feature Service. It will simply look and then time out. I have also tried all the authentication types as well and none of them work.Is anyone else having this issue?
Good afternoon all, I'm trying to create a large nested JSON document from SQL to load into MongoDB. Currently I have managed to create the JSON file but i'm not able to load it into Mongo based on the size of the documents. The maximum size for documents is 16MB while my average document size is over 50MB. A solution I have thought of is to bucket each of the sub files so that instead of thousands of documents being embedded into each root there is a maximum limit of say 500 and then a new document is created with the same root, but a continuation of the Sub documents. In the end instead of a single 50MB document I would be left with say 10 identical documents that would hold different Sub documents from one another. I could then query the set of 10 documents using $unwind so that it treated them as a single document of sorts. Does anyone know of a way to achieve this within FME Workbench instead of loading all sub documents into a root?
I have a workspace which reads a CSV (CSV Reader) file for a parameter which is used in a web service call. At the end of the workspace, the CSV file is updated (CSV Writer). This approach work OK on fme desktop; however, when it is run on FME server 2017, instead of updating the CSV file (same file as reader), it simply returns the CSV file as a download--leaving the original file unmodified.Is there any way to ensure that the file which is consumed by the reader is updated by the writer?Thanks