Using transformers to modify data.
Recently active
This is less a question and more of a finding to report. In 2016, File Geodb Open API treats date values "1901-01-01" as "19000101000000", but in 2021.2.5, the reader treats the same value as "000000". The effect is the record gets thrown out, despite the writer saying all features are written.We've had to build in a StringReplacer to find all the "000000" to replace with the original date value.Is this a bug? Update:Affects "1900-01-01" as well.
Hi, I have loads of vertices that belongs to polygons and want to change the start vertex so that the polygon always start and ends in the lower left corner. The order of the vertices must stay in the same order so its possible to rebuild the polygon. Spatial sorting works to identifiy which vertex that should be the start vertex but messes up the order of the other. Thanks
Hi, I have a 3D modell as object file. I will convert this to cesium tiles!I tried this way:Reader -> CoordinateSystemSetter -> Writer (Cesium 3D Tiles) But if I import the tiles inside cesium (e.g. cesium ion) I do not get georeferencing. So the model is not display at the correct location. Is it possbile to assign a georeference to an obj file?
Hello Sir / Madam, So I would like to subtract both "Top Height" and "Rooflevel" attributes. I use attribute manager to calculate the value@round(@abs(@Value(TopHeight)-@Value(ROOFLEVEL)),1) The result is shown as below.However, I want my result to be <null> if either TopHeight or Rooflevel is <null>. May I ask how to do it? Thank you. Zachary
I can see the imagery on the inspector but don't see anything in the GDB package that would hold the imagery. The GDB package has ATX, GDBINDEXES, GDBTABLE, GDBTABLX and SPX files.
I am reading a record from a SDE geodatabase and using that record to create a new record. What is happening though is that it is just overwriting the old record. I need to have two records at the end. I select it based on an id and essentially need to make a copy of the record and then overwrite some of the values. Any idea of how I can do that?
I know that the SharePoint List reader and the SharePointOnline connector are quite different from each other. Using a registered app on Azure worked fine for the SharePointOnline connector and its attached web service - but for the list reader, the web connection only required us to exchange the [TENANT] with our sharepoint tenant without changing anything else. This was working fine on our testing SharePoint platform using a non-personal user account to logon with. However, on our actual SharePoint platform, this trick does not work when using my own user credentials (it notifies me that the app needs admin rights) - and I am asking myself why. Does the user need to have certain rights in order to use the web connection? Then, as a second attempt, I followed the workflow here https://community.safe.com/s/article/How-to-create-a-Sharepoint-Web-Connection and it let me successfully test the connection as we have a registered app on Azure. But this failed when I tried to actually use th
I would like to see if a value from a specified column/attribute can be counted into another column based on how many times it appears across multiple columns. I hope to do this for every feature/row of a dataset. Example of the data below : In this case, I would like specify the value in the DominantValue field, and I would like to see how many times this value appears in fields: AreaCount1, AreaCount2, AreaCount3, AreaCount4, Areacount5, and AreaCount6. The number of times it appears would be stored in a field called dvcounter. For example the desired output would look something like the below table: Does anyone have any recommendations as to what transformers or workflows can provide this "count" field? I've attached a portion of the csv data that I am working with and the workspace that I am working on. This workflow builds on top of question that was recently answered by @Takashi Iijima :https://community.safe.com/s/feed/0D54Q00009RcXusSAF
Hello, newbie here. I'm using AttributeManager to rename and remove some Attributes - and to add a new Attribute using a Conditional Value based upon (among others) an Attribute named IATA, which contains airport call letters. For San Francisco International Airport, IATA contains "SFO" but for Nadi International Airport, the IATA Attribute contains "NAN". No matter how I try to force FME to treat those call letters as a string, it eventually becomes "if NAN != null... and I get "nan" as the result. Pretty sure that's a bug (2019.2). Note: Set Value with @Value(IATA) works fine with "NAN". It seems to be only the Conditional Value code that has the problem. Does anyone have an idea how to conditionally process an Attribute that may contain the value "NAN" (or other values that might also be mathematical constants)?
I think this is an easy one, however i am stumped. I have a set of data with 3 columns. Fieldname, Fieldval, RecordGroup. I simply want to aggregate by recordgroup and then rename attribute names to the value that is stored in the Fieldname. Where i am stumbling is how to rename the fields to the values in the input field. Thanks in advance.
Currently, we have a very curious problem. A workspace is made in FME Workbench desktop which runs without any problem. In the workspace, geometry in a ESRI file geodatabase is repaired by a Python script (arcpy). However, when deployed on FME Server, this process results in an unexpected error, see attached file. The account which starts and runs the process on FME server has sufficient read and write persmissions on the location where the geodatabase is stored. What could be the cause of this problem? Kind regards,Pim van der Zwaag.
Hi,Does anybody have any experience writing GDB metadata images into SDE?I can update just about anything but inserting an image to the item description needs to be in a specific ESRI binary format (EsriPropertyType="PictureX") and the AttributeFileReader transformer does not support this encoding type. Cheers, Itay
I'm using an ArcGIS Feature reader to read a layer with two tables. The two tables have 9257 and 9606 rows. After reading the two tables, I join them. At this point (with feature caching) I can see that I have 9606 rows. This is correct. The last step of the workspace is to use an ArcGIS Feature writer to populate a different layer. The ArcGIS Feature Writer has the following Parameters for Layer: Writer Mode: Insert Truncate First: Yes Currently, my destination Feature layer has 10584 rows. How could this be? How can I exceed the number of rows in my source layer? I just ran the workspace up to the Writer and can see 9606 items going into the Feature Writer. then, I ran the entire workspace and the destination layer now has 9752 rows. I'm perplexed. This is a public facing dashboard and I need accuracy. I do run this workspace from a batch file and schedule it to run at 3:00 AM with Windows Task Scheduler. I'm not sure if that matters. Any ideas? I suspect that the destin
In what way can I control the behaviour of SqlExecutor concerning transactions. I'd like to perform several inserts and updates as a single transaction (by putting the "commit"-command at the end). But this commit always results in the warning "there is no transaction in progress".Database = PostgreSQL
GDAL has a pretty handy proximity calculator where each pixel in the output raster represents the distance to the nearest pixel in the input raster. For instance, distance to the nearest road. Is there any transformer doing that in FME ? Thanks!
I have some shape files that might be corrupted i think... However reading/viewing them in ArcGIS Pro is working without any issue whereas in FME it reads them all but it mixes attributes of the features! e.g. Point 1 (shape file feature) becomes attributes from lets say point 10 (another shape file feature) an so on! All attributes are mixed! is this issue known? I am using FME 2022.0 p.s. I am just reading shape files without doing any transformation.
Hi, I have a specific use case to solve. Transform a CSV file to a Turtle file (.ttl).Here is an example:CSV file has: 12345, Fred, 2020-01-01, "Foo, Bar" I would like to then transform this row to: <http://example.com/12345> rdf:type owl:NamedIndividual ; a:name "Fred" ; a:date "2020-01-01"; a:ref "http://example.com/Foo", "http://example.com/Bar" .And then repeat for all the lines in the CSV.Any help appreciated
Hi! I´m trying to add an ID column to a GeoJSON file. I use a reader to read data from an Oracle database and then write it down using to GeoJSON writer. I need the ID not to be in the properties-section but as in the example below:https://community.safe.com/s/article/tutorial-getting-started-with-json Thankful for any suggestions on how to do this 😊
I am trying to send the MapnikRasterizer result to HTMLReportGenerator, but directly connecting them doesn't work. So I am using a TempPathnameCreator and FeatureWriter in between to write the png and then send it to the HTMLReportGenerator. However, HTMLReportGenerator can't read the path generated during the test running.FME version: 2021.2Error: HTMLReportGenerator: Unable to open image file 'D:/FME_TEMP/wbrun_1652070048335_8656/fmetmp_1c/1652075715010_34268_d\\r_2030.png.png'. Please ensure this file exists
Hi, I am trying to use ReplaceRegularExpression as described here:http://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Transformers/!Transformer_Parameters/StringFunctions.htmTo do a simple transformation of Quotes to escaped Quotes in strings. I have the following: @ReplaceRegularExpression(@Value(Description),["],"\\\\""",FALSE)(as the instructions say I need to add quotes and escape the quote in the to expression.)This does not work, but at least does not have errors.If I try to slightly change the syntax of the to expression (eg less quotes) I get serious errors... Any ideas welcome...
Currently I set the projection in the reader for the csv to match the gdb. I then added a Feature Writer transformer for the fanout creating feature classes in a staging gdb. My problem now is how do I get the feature classes the feature writer created back into the workspace so I can then use the attribute manager to map to my final gdb. I tried to use the Feature Reader transformer to add these back but have not been able to figure that out yet.
Hi,I'm trying to start a workspace runner just after a FeatureWriter has finished running, but I am getting a weird error with a '@Tcl2 function': ...WorkspaceRunner_ExecutorAndRouter (TestFactory): An error was encountered evaluating a TestFactory test: An error occurred while evaluating a test parameter: @Tcl2 function requires exactly one argument -- the expression to evaluate. If you are using static function evaluation, only one $[ .. ] pair can be on a single logical mapping file line due to parser limitationsFeatureWriter_6_SUMMARY_-1_836_Player (RecorderFactory): An error was encountered evaluating a TestFactory test: An error occurred while evaluating a test parameter: @Tcl2 function requires exactly one argument -- the expression to evaluate. If you are using static function evaluation, only one $[ .. ] pair can be on a single logical mapping file line due to parser limitations...This is happening with different workbenches. It is fine if I copy the whole workbench... But i
Hi FMErs,Has anyone had any experience importing GoCAD ts files into FME using another reader type. It appears that GoCAD is not supported directly in FME, however the geometry of the object/s appear to be 3D triangulated surfaces ?Thanks in advance
Hi I'm using Revit native reader to read Revit 2021 arch project file but having problems with transformers rejecting geometries. E.g. using MeshMerger or MeshSimplifier transformer will result in rejecting all imported geometries. Any hint how to solve this problem? I want to simplify and join geometries before writing to gltf, to get gltf file that's easy to renderThanks