Using transformers to modify data.
Recently active
Hello, I am new to streaming using FME, and have a few basic questions about how to make it work. I am looking to use FME to stream data from a GNSS receiver. Data is produced as an XML stream. This requires filtering to get the necessary features I am interested in and then I write it to a CSV and ultimately upload to Microsoft Azure. I can get the basic Web>XML>CSV>Azure process to work, but I'm struggling with the time-looping aspects. The incoming data is continuous - I want to be able to package 1-minutes worth of data into a csv, then 15-minutes worth of csvs into a folder to be uploaded into Azure (to cut down on discreet uploads). I'm not sure where to even start, although the time windower and workspace runner transformers look promising? I will have access to FME Server to automate the process. As a secondary point, does anyone know if there is a simple way to tweak readers to iterate the same process for different source URLs? We have 20+ receivers, each wit
Hello, I have a problem and I am struggling to find the solution, I have several irregular polygons and, in this specific case, I need to extract areas where the width of the polygon is less than 8 meters (limit red lines). Has anyone been through something like this?
I could import it into 3DS MAX and then export it as a callada file, 3DS file or VRML file, but it still does not appear with independent elements.Do you have an idea to help me resolve this issue ? Do you know an FME transformer that could separate/disjoin my 3D file ?
I have an ERDAS Imagine file I'm importing with a FeatureReader block. The Imagine file does not have a time component. I would like to introduce the time component to the NetCDF, effectively making a single band NetCDF with a time, latitude, longitude and value. I cannot seem to work out how to introduce a timestamp into the NetCDF. It would be sufficient to take the current timstamp and make a variable of (time, latitude, longitude). Any suggestions?
I'm having some trouble integrating FME NetCDF outputs into another process (This is a separate question to my other one). I've noticed in the documentation for the NetCDF Writer that it will rename the X / Y fields to lat and lon. Is there a way I can change these to be "latitude" and "longitude"? I'm aiming for data consistency and hoping the single output from this process can be slotted in with the other netCDFs we are processing with the same (time, latitude, longitude) schema. I cannot see a way to affect this part of the process.
This has been my fun project for some time now and I am looking for support to develop this further in FME.The preferred language is German. The FME project reads XML files as well as Openstreetmap OSM and also images are possible and creates an XML code that can be read by the Ubisoft Game Far Cry 5. The result can be seen here on the photos. And here is a Video How it works:https://youtu.be/H56twEpkHvQ
I tried to change the data types from unit8 to unit64, but without success. When I convert to xlsx, all values are loaded, but I have another problem. Vertexcreator does not create values in decimal development correctly. Why the same data, but in csv it creates the vertexcreaotor correctly and in xlsx not? I would need to either solve the correct loading in csv so that I don't have a null value - here vertexcreator creates points correctly for me, or load the data from xlsx correctly and solve the correct addition of a point by vertexceator. Or does anyone else have an idea? Thanks a lot!!!
I am trying to do an update to a PostGres database based on whether or not the created key PID is present or not. If the created key PID is present for the row it updates the row with the new information if not it inserts it as new row. The problem is the test for the difference created a different stream and it won't let me have two writers writing to the same table. The table name gets a 00 appended to it and can not be changed to be the same as the other stream. This seems like I am missing something simple as database operations go but why will FME not let me set two different writers to the same database table to satisfy the two possible condiditions?
Situation: I have geometry in a local coördinate system and through the affineWarper and vertex creator I can transform it and move to the actual location in the coördinate system I prefer. The problem is that the affine warper needs 4 points and I only have two points of reference placed in an old analogue drawing. Is there a simple way using FME to create these extra two points for me? So far I've georeferenced the analogue drawing twice to get the coordinates I need. This is quite time consuming and I have a feeling there should be an easier way.
I find it REALLY difficult to use FME for feature change detection.I'm using an api to grab weather data and store it in a table. Occasionally the api might send an updated value for one of the records.So I might have STATION_NAME, DATETIME and VALUE from the api to match against the existing record.I can use the FEATURE_JOINER to join the STATION_NAME and DATETIME, but then need to update the value.Any idea what the best method is? I have tried the FEATURE_MERGER and CHANGE_DETECTOR, but neither seem to be simple to set up or understand...
HiI want to apply a transformation to all the files contained in the root folder "Vuelo84" (see attached image ). Those files are in their subfolders. I know how to load all of them in the reader, but I would like that the transformed files would be located in their own new subfolders, created by the FME itself at the same processing time. Is it possible? Thanks!
I am using Directory and filepath name read and then FilePropertyExtractor to build a table with all files of a specific file type. I then use time stamper to create the file name. subsequently the workspace is run a second time and the previous file (using sorter and sampler) is pulled into feature reader and then to the ChangeDetector.I can't seem to add a uuid because it recreates a new one each time i run it. So i can't use that as an update key.So right now i am using the unix path as an update key and i get all features as updated. (when there are no changes)If i set the check attr types and encodings to yes i get all of the original as deleted and all the revised as inserted.I just read that the order makes a big difference in the CDor. So i rearranged a bit and added sorters. Then I had to reformat my date modified attribute. and i think that might be it.I would take any suggestions anyone has to make this better. It is going to have ot run over an entire network (which
I'm reading a PostGIS database layer that is formatted as 'Text'. PostGIS treats this as basically an unlimited-width VARCHAR field. However, the FME PostGIS Reader truncates this field's input to 80 characters, and I can't get it to change to accommodate more characters.
Hi,I would like to change the results of a GeoJSON writer when there's no attributes that pass my transformers. For example, when I got what its like in the left picture, I got a reply from my GeoJSON writer like so : { "type" : "FeatureCollection", "name" : "aspvhn_Strct_sur", "features" : [ { "type" : "Feature", "geometry" : { "type" : "Point", "coordinates" : [ -73.8119918787, 45.6095554592 ] }, "properties" : { "idstruct" : null, "producteur" : "MTQ" } }.But, when its like the right picture, I got nothing from the GeoJSON writer. What I want is that when I got no attribute that pass my transformers, i'll still have an answer that looks like what you see as above but with space instead of nothing at all. Thanks.
Hello. I have textured CityGML files that I want to reproject. When I use EsriReprojector transformer, the result is successful, however, the written CityGML files lost textures. Appearance parts completely lost in my output files. How can I keep texture?
I request the MVT files with these urls. (behind password)https://maps-ver.lantmateriet.se/vt/fastighetsindelning/v1/wmts/1.0.0/fastighetsindelning/default/3006/10/1500/1600.mvt (then /1501/1600.mvt etc.) Generated files in Drive link (https://drive.google.com/drive/folders/16XT71TQnF-bQFYHZ2zv87PR22a7_EJB3?usp=sharing Style information: https://maps-ver.lantmateriet.se/vt/fastighetsindelning/v1/wmts?request=GetCapabilities&version=1.0.0&service=wmts From provider Tilematrixset is 3006 (SWEREF99 TM). I generate workspace and select all four MVT files with the following settings and press run.The generated GeoJSON files have the information stacked on top of each other on the same coordinates which are incorrect. Not sure what to do.
Bonjour. J'ai un attribut au format numérique et je souhaite le transformer au format date ? Commentaire faire ? Exemple la valeur numérique est 2017 et je veux la valeur au format date 01/01/2017. Merci pour votre aide
Hello, I'm stuck on trying to transform attributes in a DWG to a GDB , and am encountering a projection error. This is specifically for the DWG's annotation/text - the line and area geometry is successful. The projection is from Perth Coastal Grid 1994 (PCG94) projection to WGS1984 Web Mercator Auxillary Sphere (EPSG:3857). The error messages are below: Reprojector: Reprojection failedReproject: Failed to reproject these attribute pairs: autocad_alignment_x / autocad_alignment_yEsriReprojector_4: Reproject: Could not reproject the geometry of the preceding feature: Reprojector: Could not reproject feature from `_FME_1' to `_SPHERICAL_MERCATOR_0'. Coordinates out of range I've separated out the line/area and text geometries to test the success of each. I've tried using the 2DForcer to no avail. I've also tried using a Tester to filter out potential 'problem' annotation layers but every single one is getting caught. I'm aware of Csmapprojector, ho
Hello guys,This is my first FME script I am trying to convert new JEPGS in a folder to PDF how do I do that ? what transformers and how to is et my readers and writer to be taking all the new JPEGs and converting them into PDFs with the same names ?
I'm reading in an excel file to extract an interest percentage. Due to the format I receive the file in, I'm using a substring extractor to remove the % sign and then dividing the number by 100 to get in the proper format. It looks like between the excel file and the arithmetic editor, the number is being rounded up. Anyone know how to prevent this? Screenshots of original excel and inspector results provided. The number in the screenshots I'm focusing on is 98.517% changing to 98.520 - 0.98520.
Hey there,What effect does the parameter 'Ignore Nulls' in SQLExecutor have?Or in other words: What happens when the SQL statement doesn't give a result? In my workspace these features are not going through the Result-output. In fact, they get lost :-(.I know I can do several workarounds, e.g. merge the output with the initiator via an unique attribute or modify my SQL statement (which will be something like 'select nvl(min(ATTR),'doe') from ...'), but I expected the parameter 'Ignore Nulls' might give me the non-resulting features with a NULL-value in the result. -Maria (using FME 2021.0)
Hi all, I've created a workflow in the workbench to extract historical data and store in a database. The JSON Reader contains date at the end of the URL For this time being, I have to manually change the date and then run the workflow. This is quite tiring as the duration for the historical data is long. Do you guys have any idea or is there any other method or transformer to automatically change the date in the JSON Reader before running the workflow.
Hi,I am hoping someone in the community can help me with the issue I am experiencing during ArcGIS Indoors to IMDF transformation. Openings features, which are part of the Details FC in my ArcGIS indoors information model, are not being picked up during the FME transformation process - meaning the output does not contain openings.geojson file at all.FME transformation phase that extracts the openings from Details features seems to be passing as expected. Feature geometry checks are also passed, but then the FeatureTypeFilter leaves them Unfiltered.The reason for this might be in the fact that assigned IMDF category for these features is set as pedestrian (which I understand is one of the allowed IMDF subcategories for Openings). I would appreciate if anyone can offer some assistance. Thanks
Hello I'm tryng to run a workspace in FME Server but this error is show during translation: XML Parser error: 'Error in input dataset:'/mnt/efs/fs1/resources/data/Products_LEDE/PCP/Netherlands/NLD_201G0_PCP/1_Src/BAG/Inspire_data_NLD/9999NUM08112020.zip' line:1 column:57 message:invalid byte '�' at position 2 of a 3-byte sequence'The XML Module halted on error, see the logfile for details I have run the workspace locally to check if the file was damaged or something similar, but it ran correctly with no issues.... Does anyone know how to solve this issue, please? I need your help
I have installed the JDBC driver and we are using Apache Hive Kerberos security connection. Can you please help me with the documentation that how to connect with Hive Kerberos security .FME VERSION: ME(R) 2021.0.2.0 (20210429 - Build 21321 - WIN64)