Using transformers to modify data.
Recently active
I am reading a record from a SDE geodatabase and using that record to create a new record. What is happening though is that it is just overwriting the old record. I need to have two records at the end. I select it based on an id and essentially need to make a copy of the record and then overwrite some of the values. Any idea of how I can do that?
I know that the SharePoint List reader and the SharePointOnline connector are quite different from each other. Using a registered app on Azure worked fine for the SharePointOnline connector and its attached web service - but for the list reader, the web connection only required us to exchange the [TENANT] with our sharepoint tenant without changing anything else. This was working fine on our testing SharePoint platform using a non-personal user account to logon with. However, on our actual SharePoint platform, this trick does not work when using my own user credentials (it notifies me that the app needs admin rights) - and I am asking myself why. Does the user need to have certain rights in order to use the web connection? Then, as a second attempt, I followed the workflow here https://community.safe.com/s/article/How-to-create-a-Sharepoint-Web-Connection and it let me successfully test the connection as we have a registered app on Azure. But this failed when I tried to actually use th
I would like to see if a value from a specified column/attribute can be counted into another column based on how many times it appears across multiple columns. I hope to do this for every feature/row of a dataset. Example of the data below : In this case, I would like specify the value in the DominantValue field, and I would like to see how many times this value appears in fields: AreaCount1, AreaCount2, AreaCount3, AreaCount4, Areacount5, and AreaCount6. The number of times it appears would be stored in a field called dvcounter. For example the desired output would look something like the below table: Does anyone have any recommendations as to what transformers or workflows can provide this "count" field? I've attached a portion of the csv data that I am working with and the workspace that I am working on. This workflow builds on top of question that was recently answered by @Takashi Iijima :https://community.safe.com/s/feed/0D54Q00009RcXusSAF
Hello, newbie here. I'm using AttributeManager to rename and remove some Attributes - and to add a new Attribute using a Conditional Value based upon (among others) an Attribute named IATA, which contains airport call letters. For San Francisco International Airport, IATA contains "SFO" but for Nadi International Airport, the IATA Attribute contains "NAN". No matter how I try to force FME to treat those call letters as a string, it eventually becomes "if NAN != null... and I get "nan" as the result. Pretty sure that's a bug (2019.2). Note: Set Value with @Value(IATA) works fine with "NAN". It seems to be only the Conditional Value code that has the problem. Does anyone have an idea how to conditionally process an Attribute that may contain the value "NAN" (or other values that might also be mathematical constants)?
I think this is an easy one, however i am stumped. I have a set of data with 3 columns. Fieldname, Fieldval, RecordGroup. I simply want to aggregate by recordgroup and then rename attribute names to the value that is stored in the Fieldname. Where i am stumbling is how to rename the fields to the values in the input field. Thanks in advance.
Currently, we have a very curious problem. A workspace is made in FME Workbench desktop which runs without any problem. In the workspace, geometry in a ESRI file geodatabase is repaired by a Python script (arcpy). However, when deployed on FME Server, this process results in an unexpected error, see attached file. The account which starts and runs the process on FME server has sufficient read and write persmissions on the location where the geodatabase is stored. What could be the cause of this problem? Kind regards,Pim van der Zwaag.
Hi,Does anybody have any experience writing GDB metadata images into SDE?I can update just about anything but inserting an image to the item description needs to be in a specific ESRI binary format (EsriPropertyType="PictureX") and the AttributeFileReader transformer does not support this encoding type. Cheers, Itay
I'm using an ArcGIS Feature reader to read a layer with two tables. The two tables have 9257 and 9606 rows. After reading the two tables, I join them. At this point (with feature caching) I can see that I have 9606 rows. This is correct. The last step of the workspace is to use an ArcGIS Feature writer to populate a different layer. The ArcGIS Feature Writer has the following Parameters for Layer: Writer Mode: Insert Truncate First: Yes Currently, my destination Feature layer has 10584 rows. How could this be? How can I exceed the number of rows in my source layer? I just ran the workspace up to the Writer and can see 9606 items going into the Feature Writer. then, I ran the entire workspace and the destination layer now has 9752 rows. I'm perplexed. This is a public facing dashboard and I need accuracy. I do run this workspace from a batch file and schedule it to run at 3:00 AM with Windows Task Scheduler. I'm not sure if that matters. Any ideas? I suspect that the destin
In what way can I control the behaviour of SqlExecutor concerning transactions. I'd like to perform several inserts and updates as a single transaction (by putting the "commit"-command at the end). But this commit always results in the warning "there is no transaction in progress".Database = PostgreSQL
GDAL has a pretty handy proximity calculator where each pixel in the output raster represents the distance to the nearest pixel in the input raster. For instance, distance to the nearest road. Is there any transformer doing that in FME ? Thanks!
I have some shape files that might be corrupted i think... However reading/viewing them in ArcGIS Pro is working without any issue whereas in FME it reads them all but it mixes attributes of the features! e.g. Point 1 (shape file feature) becomes attributes from lets say point 10 (another shape file feature) an so on! All attributes are mixed! is this issue known? I am using FME 2022.0 p.s. I am just reading shape files without doing any transformation.
Hi, I have a specific use case to solve. Transform a CSV file to a Turtle file (.ttl).Here is an example:CSV file has: 12345, Fred, 2020-01-01, "Foo, Bar" I would like to then transform this row to: <http://example.com/12345> rdf:type owl:NamedIndividual ; a:name "Fred" ; a:date "2020-01-01"; a:ref "http://example.com/Foo", "http://example.com/Bar" .And then repeat for all the lines in the CSV.Any help appreciated
Hi! I´m trying to add an ID column to a GeoJSON file. I use a reader to read data from an Oracle database and then write it down using to GeoJSON writer. I need the ID not to be in the properties-section but as in the example below:https://community.safe.com/s/article/tutorial-getting-started-with-json Thankful for any suggestions on how to do this 😊
I am trying to send the MapnikRasterizer result to HTMLReportGenerator, but directly connecting them doesn't work. So I am using a TempPathnameCreator and FeatureWriter in between to write the png and then send it to the HTMLReportGenerator. However, HTMLReportGenerator can't read the path generated during the test running.FME version: 2021.2Error: HTMLReportGenerator: Unable to open image file 'D:/FME_TEMP/wbrun_1652070048335_8656/fmetmp_1c/1652075715010_34268_d\\r_2030.png.png'. Please ensure this file exists
Hi, I am trying to use ReplaceRegularExpression as described here:http://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Transformers/!Transformer_Parameters/StringFunctions.htmTo do a simple transformation of Quotes to escaped Quotes in strings. I have the following: @ReplaceRegularExpression(@Value(Description),["],"\\\\""",FALSE)(as the instructions say I need to add quotes and escape the quote in the to expression.)This does not work, but at least does not have errors.If I try to slightly change the syntax of the to expression (eg less quotes) I get serious errors... Any ideas welcome...
Currently I set the projection in the reader for the csv to match the gdb. I then added a Feature Writer transformer for the fanout creating feature classes in a staging gdb. My problem now is how do I get the feature classes the feature writer created back into the workspace so I can then use the attribute manager to map to my final gdb. I tried to use the Feature Reader transformer to add these back but have not been able to figure that out yet.
Hi,I'm trying to start a workspace runner just after a FeatureWriter has finished running, but I am getting a weird error with a '@Tcl2 function': ...WorkspaceRunner_ExecutorAndRouter (TestFactory): An error was encountered evaluating a TestFactory test: An error occurred while evaluating a test parameter: @Tcl2 function requires exactly one argument -- the expression to evaluate. If you are using static function evaluation, only one $[ .. ] pair can be on a single logical mapping file line due to parser limitationsFeatureWriter_6_SUMMARY_-1_836_Player (RecorderFactory): An error was encountered evaluating a TestFactory test: An error occurred while evaluating a test parameter: @Tcl2 function requires exactly one argument -- the expression to evaluate. If you are using static function evaluation, only one $[ .. ] pair can be on a single logical mapping file line due to parser limitations...This is happening with different workbenches. It is fine if I copy the whole workbench... But i
Hi FMErs,Has anyone had any experience importing GoCAD ts files into FME using another reader type. It appears that GoCAD is not supported directly in FME, however the geometry of the object/s appear to be 3D triangulated surfaces ?Thanks in advance
Hi I'm using Revit native reader to read Revit 2021 arch project file but having problems with transformers rejecting geometries. E.g. using MeshMerger or MeshSimplifier transformer will result in rejecting all imported geometries. Any hint how to solve this problem? I want to simplify and join geometries before writing to gltf, to get gltf file that's easy to renderThanks
I am writing from a csv where all the fields are text. One of these fields contains a date 10/11/2021. I need to load this to a geodatabase that has the field formatted as a date. I need the date to look the same in the field I am mapping to. I have tried many different things and am probably just missing something but I can't get this to work. Attached is what my current workspace looks like. I believe I need to do this in the attribute manager using the dat time format but I am not figuring out how to dot his properly.
When I run this workspace locally, it puts out a .prj file and all is well. The issue only occurs on fme server. there is no prj in the zipped download.
Hi list.I'm trying to convert a DWG in a local system to UTM. I'm using AffineWarper, and has identified 5-6 control points, that seems to work.When viewing the output in Data Inspector, all looks well, but when I output it to a new DWG, and view that in Data Inspector, it's not good at all.All text features are either still in the local system (masquarading as UTM, i.e. at Equator), or someplace else. Only regular geometries are located correctly.Is this a known issue, and if so, is there a work-around for this ?Cheers.
Hi,I am working on a project where I need to create a new SharePoint list from PostgreSQL data each year.I have three items that I need to put into my list. Two choices fields (called Company and Indicator)A text field (called Feedback) At first, I used the Sharepoint List Writer but it looks like the properties of the Choice field are not what I want because the Choice field is configured to allow free-form input. And secondly, when the list is created, I don't know how I can write into the Title field (the best would be to make it not mandatory). So, my idea was to use the Sharepoint Rest API to do a PUT request in order to create my customized list, but even with the topics I found online, I am not able to do anything other than GET requests... Anyone can help me on what I need to do to create this list ?Thanks for your help and have a good day, CPTSDN_17.
What I need to do is seperate the table by type. The types can be water, industries, woods etc. All are in the same table in postgis. So what I need to do is to get one outport for each value somehow. Later I will turn these in to raster data with 3dforcer. Can anyone help me? Best regardsJesper