Using transformers to modify data.
Recently active
Hello, this is a pretty basic question, but I have been wracking my brain as to how to do it. When I read data from an XML file, it treats each value in my data as a new feature/row. This means that when I convert the features into CSV format, I get one value per line, as opposed to a long string of values delimited by commas. (see the two pictures to get a sense of what I mean). Is there an easy way to fix this? The basic solution in something like excel would be to transpose the data, but there doesn't seem to be a simple functionality for that. (Additionally, if anyone after looking at my workspace has a better way to get my 'msec' values to be first in the csv, I'm all ears!) Any help would be appreciated!
Hi everyone. I have a easy question but i can't be able to ressolve. I have a bulkattributerenamer. The reader is a Directory and path filename. The folder containt PDF (no spatial). The name of all the PDF begin with __, like __PZ440.pdf. I want to remove the __ for keep the PZ440.pdf But i have some trouble with the writer. I can't find the right writer. I know is a beginner question so thank you for help
I have two things that I am trying to accomplish with the current feature/attributes that I have joined. For each row of data, I need to write out 5 new rows. Also, in the new rows, some of the column values are the column names of the input feature. Here is an example: (Attribute Name: Attribute Value)input: ASSETNUM: 12345, VLVCOND:Good, TRNSOPEN:10, OPENDRTN: Clockwise, STRUCTUR:No, SURCOVER: Blue, INSPECTOR:Joe SmithOutput: ASSETNUM:12345, METERNAME:VLVCOND, OBSERVATION:Good, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:TRNSOPEN, OBSERVATION:10, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:OPENDRTN,OBSERVATION:Clockwise, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:STRUCTUR, OBSERVATION:No, INSPECTOR:Joe Smith ASSETNUM:12345, METERNAME:SURCOVER, OBSERVATION:Blue, INSPECTOR:Joe Smith Any help would be greatly appreciated.Thanks.
I have a 2016.1.1 workspace, reading from gdb, writing to dwg (Autodesk AutoCAD Map 3D Object Data).When I run it on Desktop, I get the following errors.2019-07-03 12:13:55| 5.9| 0.0|WARN |Library 'D:\apps\fme_2016_1_1_64\plugins/realdwg/REALDWG.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this library2019-07-03 12:13:55| 5.9| 0.0|ERROR |Module 'AUTOCAD_OD' is unavailable for use with this FME edition2019-07-03 12:13:55| 5.9| 0.0|ERROR |Module 'AUTOCAD_OD' is unavailable for use with this FME edition2019-07-03 12:13:55| 5.9| 0.0|ERROR |FeatureWriter_3(WriterFactory): Module 'AUTOCAD_OD' is unavailable for use with this FME edition2019-07-03 12:13:55| 5.9| 0.0|ERROR |Module 'AUTOCAD_OD' is unavailable for use with this FME editionWhen I run it on Server, I get the same errors for some datasets, but not all.I synced back the production data to my local machine, run the workbench with the same dataset as it works on server, and st
Hello. I have a question. Is there a transformer that can filter based on attribute values? Something like SpatialFilter, but without spatial data. I have two datasets in the workspace and I need to compare one column in each dataset against each other and get only those rows in the output where the value will be the same. I tried to look for some more filters, but I didn't find anything functional. Thank you, very much
I have point table and polygon table in PostgreSQL / PostGIS The polygon table is a series of concentric polygons getting ever smaller / nearest the point See PictureEach point could be in 1 or many polygonsWithin this table is a level column How do I perform a spatial query returning the join between the polygon contains the point where MAX(level) ? The result I’m expecting is 1 polygon per point (A polygon can contain 1 or more points)
why i can not use the FMESpatialIndex in pythoncaller? it will report the desktop can not support some function
It is possible to ground truth one or a few prior or possibly mosaic them together and then to add georeferencing after.
The Writer is generating SQL for an Attribute that doesn't exist in the Feature, during an Update operation on a Postgres table. Here is the error message:Error executing SQL command ('update "schema_name"."table_name" set "date_created" = NULL,"date_updated" = E'2021-05-18T07:47:58.73945-07:00',"distance" = E'1.00' WHERE "unique_id" = E'51''): 'ERROR: null value in column "date_created" violates not-null constraint During an Update operation, date_created should not be changed. Although the data flow is read from the same table it's being written to, an AttributeManager specifically removes date_created from the Features on the ChangeDetector's Updated port. unique_id=51 is the very first Feature being fed to the Writer. Like every other Feature from the Updated port, its fme_db_operation Attribute is "UPDATE". The Feature Operation field of the Writer is con
When I use FeatureWriter to output multiple GeoTiffs to a single KML Images file, all of the images are correctly registered. When I change the FeatureWriter to fan out the KML using a feature attribute, the the images are no longer correctly registered when viewing the KML in Google Earth. The individual GeoTIFFS saved to the \\images directory are correctly registered. Bug or am I missing something? This works ... This results in a bad KML file ...
I have a workspace that generates multiple GeoTiffs that have feature attributes that I use for naming the files in Feature Writer. e.g. ...I want to modify the workspace and change the FeatureWriter to write the images to KML/KMZ.When I change the FeatureWriter to write KML I lose the ability to name the images. Is there a way to name the images before the enter the FeatureWriter?
Hi, I'm currently trying to do a itinerary with my HTTPCaller with the posibility to have 2 itinerary. You can see the the request url that I'm getting. The query string parameters have a parameter called "Choixroute" which is the route choosen, going from 0 to 1. When the "choixRoute" is at 0,the result is the road option 1 . But, when I change it to 1, it is still the road options 1 and not the option 2. Is it something that I have to change in my HTTPCaller or in JSONfragmenter? Thank you in advance, Ian
Hello, I am new to streaming using FME, and have a few basic questions about how to make it work. I am looking to use FME to stream data from a GNSS receiver. Data is produced as an XML stream. This requires filtering to get the necessary features I am interested in and then I write it to a CSV and ultimately upload to Microsoft Azure. I can get the basic Web>XML>CSV>Azure process to work, but I'm struggling with the time-looping aspects. The incoming data is continuous - I want to be able to package 1-minutes worth of data into a csv, then 15-minutes worth of csvs into a folder to be uploaded into Azure (to cut down on discreet uploads). I'm not sure where to even start, although the time windower and workspace runner transformers look promising? I will have access to FME Server to automate the process. As a secondary point, does anyone know if there is a simple way to tweak readers to iterate the same process for different source URLs? We have 20+ receivers, each wit
Hello, I have a problem and I am struggling to find the solution, I have several irregular polygons and, in this specific case, I need to extract areas where the width of the polygon is less than 8 meters (limit red lines). Has anyone been through something like this?
I could import it into 3DS MAX and then export it as a callada file, 3DS file or VRML file, but it still does not appear with independent elements.Do you have an idea to help me resolve this issue ? Do you know an FME transformer that could separate/disjoin my 3D file ?
I have an ERDAS Imagine file I'm importing with a FeatureReader block. The Imagine file does not have a time component. I would like to introduce the time component to the NetCDF, effectively making a single band NetCDF with a time, latitude, longitude and value. I cannot seem to work out how to introduce a timestamp into the NetCDF. It would be sufficient to take the current timstamp and make a variable of (time, latitude, longitude). Any suggestions?
I'm having some trouble integrating FME NetCDF outputs into another process (This is a separate question to my other one). I've noticed in the documentation for the NetCDF Writer that it will rename the X / Y fields to lat and lon. Is there a way I can change these to be "latitude" and "longitude"? I'm aiming for data consistency and hoping the single output from this process can be slotted in with the other netCDFs we are processing with the same (time, latitude, longitude) schema. I cannot see a way to affect this part of the process.
This has been my fun project for some time now and I am looking for support to develop this further in FME.The preferred language is German. The FME project reads XML files as well as Openstreetmap OSM and also images are possible and creates an XML code that can be read by the Ubisoft Game Far Cry 5. The result can be seen here on the photos. And here is a Video How it works:https://youtu.be/H56twEpkHvQ
I tried to change the data types from unit8 to unit64, but without success. When I convert to xlsx, all values are loaded, but I have another problem. Vertexcreator does not create values in decimal development correctly. Why the same data, but in csv it creates the vertexcreaotor correctly and in xlsx not? I would need to either solve the correct loading in csv so that I don't have a null value - here vertexcreator creates points correctly for me, or load the data from xlsx correctly and solve the correct addition of a point by vertexceator. Or does anyone else have an idea? Thanks a lot!!!
I am trying to do an update to a PostGres database based on whether or not the created key PID is present or not. If the created key PID is present for the row it updates the row with the new information if not it inserts it as new row. The problem is the test for the difference created a different stream and it won't let me have two writers writing to the same table. The table name gets a 00 appended to it and can not be changed to be the same as the other stream. This seems like I am missing something simple as database operations go but why will FME not let me set two different writers to the same database table to satisfy the two possible condiditions?
Situation: I have geometry in a local coördinate system and through the affineWarper and vertex creator I can transform it and move to the actual location in the coördinate system I prefer. The problem is that the affine warper needs 4 points and I only have two points of reference placed in an old analogue drawing. Is there a simple way using FME to create these extra two points for me? So far I've georeferenced the analogue drawing twice to get the coordinates I need. This is quite time consuming and I have a feeling there should be an easier way.
I find it REALLY difficult to use FME for feature change detection.I'm using an api to grab weather data and store it in a table. Occasionally the api might send an updated value for one of the records.So I might have STATION_NAME, DATETIME and VALUE from the api to match against the existing record.I can use the FEATURE_JOINER to join the STATION_NAME and DATETIME, but then need to update the value.Any idea what the best method is? I have tried the FEATURE_MERGER and CHANGE_DETECTOR, but neither seem to be simple to set up or understand...
HiI want to apply a transformation to all the files contained in the root folder "Vuelo84" (see attached image ). Those files are in their subfolders. I know how to load all of them in the reader, but I would like that the transformed files would be located in their own new subfolders, created by the FME itself at the same processing time. Is it possible? Thanks!
I am using Directory and filepath name read and then FilePropertyExtractor to build a table with all files of a specific file type. I then use time stamper to create the file name. subsequently the workspace is run a second time and the previous file (using sorter and sampler) is pulled into feature reader and then to the ChangeDetector.I can't seem to add a uuid because it recreates a new one each time i run it. So i can't use that as an update key.So right now i am using the unix path as an update key and i get all features as updated. (when there are no changes)If i set the check attr types and encodings to yes i get all of the original as deleted and all the revised as inserted.I just read that the order makes a big difference in the CDor. So i rearranged a bit and added sorters. Then I had to reformat my date modified attribute. and i think that might be it.I would take any suggestions anyone has to make this better. It is going to have ot run over an entire network (which
I'm reading a PostGIS database layer that is formatted as 'Text'. PostGIS treats this as basically an unlimited-width VARCHAR field. However, the FME PostGIS Reader truncates this field's input to 80 characters, and I can't get it to change to accommodate more characters.