Using transformers to modify data.
Recently active
Hey Team! I'm scratching my head over a problem that I'm sure one of the gurus on here can help with. I have some very large spatial files that I need to store in a Snowflake environment. Snowflake has a few big issues when it comes to spatial data. It has very strict acceptance criteria on anything submitted as geometry so we have decided to store all of the spatial information as a binary field to pull out later (using GeometryExtractor) . However when writing this binary attribute to snowflake there is a size limit of 16MB... and when some of your features have over a million vertices this is not really going to work. We are looking into storing the FME binary over a number of attributes (_geom1, _geom2, ect.) to stick back together when needed, but cant get any string based functions to work due to it now being in binary format. I have tried substring extractors and attribute compressors with not much luck. Any Idea?
Hello everyone, I can't seem to find anything about this so decided to post a question here. We've been having issues with some of our automations ever since we upgraded from FME 2020 to FME 2022. These workflows use SchemaMapper to configure and export shapefiles based on a clipped location, and what we've been seeing is that the SchemaMapper will fail (the logs say something like "A required column was not found, row fme_feature_type will be skipped") and a bunch of the shapefiles that should have been clipped and saved in the output folders are missing. I noticed that, even though the Schema Mapper is able to read the Excel spreadsheet we're using (ie. everything shows up properly in the "Parameters" section), once you hit the 'Next' button the Preview appears empty. That is, all the tables show up in the pull-down menu but the view pane itself appears empty (see screenshot 1). And this is what shows up in the Create Attribute Map window (
HI. When parsing Clinic_Electrical.ifc using the attached ifc2obj.fmw, it fails because the material file is not created.I am inquiring as the cause is unknown. please answer about my question. Regards,Bongsup Kim
hi, i am getting errors, when trying to implement an old workspace, witch was created in datainteroperability extension in arcmap 10.8. Now upgrading to a higher version of python and ArcGISPro i have difficulties with dwg writter. As soon as i add layers from .shp, to dwg writzter i get an error. .shp has correct coordinate system. Also an old model on older version works. Does someone have an idea what could it be? There is a log of an error: FME Configuration: Destination coordinate system set to input coordinate system `_FME_0'Dynamically creating layer `visina_topo_znak'Dynamically creating layer `id_visine'ACAD writer: Splitting bulk features into individual featuresFME Configuration: Using ESRI Reprojection EngineReprojector: Implicit reprojection prohibited from `_FME_1' (GCS: `GCS_Slovenia_1996') to `_FME_0' (GCS: `GCS_unnamed') using the Esri reprojection engine; specify a geotransformation using @Reproject or the EsriReprojector transformerEsri Re
For example the value 1.7 is read as 1.7000000000000002. I guess the json utility is using float data type that cannot store just a 1.7. It stores the closest possible value = 1.7000000000000002. I need to round the value to get rid of the extra digits. But I don't know the string representation of the value in the JSON file . So I don't know the scale of the value. The only possibility I have is to set a fixed number in the AttributeRounders decimal places.This is highly irritating!It would be better if the JSON reader tool would also return the scale of the float so I can round the value properly. Or it would be nice if I could set the tools to return the string of the float value and I do the conversion into a number my self.Do you know a workaround for this problem?
how can i extract the attributes [Equipment-ID, Cleint-ID, Height and Date] from this xml? Any help will be highly appreciated. Kind regards,Keller.
Hello, I would greatly appreciate your assistance or suggestions regarding an algorithm that is on my mind. Create the contour around the road or, as an alternative option, use the model alignment → → Add the lines perpendicular to the road at every 1 meter →→ Validate intersections with the surface model provided in Input 2 →→ Examine the length of each line segment → → If the length exceeds 1 meter, highlight the line in green for a positive difference and in red for a negative difference (additional variables can be considered for future discussions).Output: DWG file containing attributes representing the lengths of these segments.
How would I configure ftp caller to upload multiple PDF files to an ftp site?I tried Transfer Type - Upload a File and used a wildcard in the path, *.pdf, but this was rejected. I know how to use FTPCaller to upload a single file. I have included a screenshot of the FTPCaller parameters I chose but these result in a rejection. I want to upload all ftp files in a particular folder to my ftp site. If FTPCaller cannot upload "all pdf files in a particular folder", what other transformer should I use?
Hello, I am trying to use Python Creator to read a shapefile from user parameter input file and expose all the attributes to be able to use the data later in the workflow. Is it possible to do it? The reason of not using shapefile Reader is that the attributes of multiple input shapefiles can differ. The goal of the FME is to import the shapefiles into a database (the final DB table attributes must be equal to the attributes of input shapefile). Thank you.
Hello,After reading a file geodatabse, I realized that for some fields are empty. When reading the same geodabase in arcmap or in qgis, the fields are not empty. What could be the reason and how to fix it?
Hello everyone! I'm having a problem with one of my layers in one of my GML files. Here's a screenshot of the problem: Do you know why there is this error on my data? The data is in 'line' format. Thanks in advance for your feedback! All the best, Dozhwal
I would like to know if it is possible to run several fme workbench that will write in parallel to a file geodatabase at the same time with each workbench writing to different feature classes? I tried this but it is not working and I don't know why. @Takashi Iijima and others, any thoughts on this?
I have data coming in from an instrument. It contains the readings for gasses like oxygen and H2S. I am trying to create a report to highlight the highest value in a given hour on a given day. With the table below: Instrument 1 | 10:00 AM | March 1st | Unit ABC 123 | H2S 10 ppmInstrument 1 | 10:05 AM | March 1st | Unit ABC 123 | H2S 5 ppmInstrument 1 | 10:10 AM | March 1st | Unit ABC 123 | H2S 0 ppm...Instrument 1 | 10:00 AM | March 2nd | Unit ABC 123 | H2S 10 ppmInstrument 1 | 10:05 AM | March 2nd | Unit ABC 123 | H2S 15 ppm... I would want the report to show me the following,Instrument 1 | 10:05 AM | March 2nd | Unit ABC 123 | H2S 15 ppmInstrument 1 | 10:00 AM | March 1st | Unit ABC 123 | H2S 10 ppm because those values are the highest gas reading for each hour, (10 AM as a record, 11 AM as another etc) on each unique day. I have tried the statistics calculator, but it doesn't allow you to accumulate the other attributes, or allow you to find unique fields to 're-merge'
Hi,I have a process where I have identified the closest two points to each point (using the NeighborFinder), then created polylines from the source point to each of the closest points, using the VertexCreator (Add Point, closest candidate x, closest candidate y). The process runs and seemingly creates the lines (attribute table shows the features), but the lines aren't visible in the inspector nor when I write them to a .gdb. When I click in the area where I know there is a line on the inspector, the attribute table selects the record - but the line isn't visible? Has anyone experienced this before?
I've tried following the steps here: Article Detail (safe.com) but my kmz folder name doesn't appear in the "Select Feature Types" dialog
Hey Safers ... Long time listener, first time caller. Go easy! See below, I'm iterating over rows in a CSV, using these to build ArcGIS Map Server URLs, pulling features from the services, and writing them out to GDB (eventually SDE) feature classes. I use the Map Server layer numbers to build my URLs, in turn these layer numbers are assigned to my schema and feature_types, and eventually become the feature class names in my GDB. Has anyone got any pointers on how I can use the more friendly layer_name values to name my feature classes? Thanks in advance! Sam
Hi there,we have a workspace where we check with a HTTPCaller, if an URL has data to download. This workspace works perfectly in FME Form. If we notice, that there are no data available, we want to become an E-Mail in order to react on time. We have created an automation in FME Flow with an E-Mail-block. Now we do not know how can we make the match: No data to download (FME Form) -> Action failed way in FME Flow in order to send the mailData to download (FME Form) -> Action successful in FME in order to log a message how can we make it? Thanks a lot in advance
I am creating the desktop version first but it will eventually be published to FME Server so the specific file choice would need to be done using a user parameter.Ideally, I would like the generic reader to be able to accept any of the following file formats: feature class, shapefile, GeoJSON and CSV. I have created a published user parameter for File/URL which would allow the user to locate the file they wanted to run through the workbench.Currently, when I try to add this user parameter in as the Dataset for a generic reader, I get the following error:Workspace generation failed. Parameter file was C:\\Users\\********\\AppData\\Local\\Temp\\FME_1697209596703_9204. I have also set up a workbench where I tried filtering to feature readers for specific formats e.g. feature class would have it's own Feature Reader where the Format is: Esri Geodatabase(File Geodb) and the Dataset is still my user parameter. However, in this example, it needs to know the name of the feature class(Feat
Hello everyone, is there any way how to generate next letter of alphabet? E.g I have feature with value "A" and I wanna generate next letter in alphabet, so letter "B". Is there any function for that? Thanks a lot! Lubo
Hi, Is it possible to upload an entire folder from a local PC to Flow Shared resources, via server/automation app? I know that single files are able to be uploaded, but I was hoping my workflow would go like this: User uploads file via web app. It is stored in Shared resourcesSeparate workbench uses a Path reader on the file, gets all .shp files and performs ETLI can't see any other way to do it, other than the user having to upload 20 different shape files via the app interface. I get this warning when using FME copy writer, with s published parameter of 'filecopy_source_dataset':File Copy Writer: Feature contains an invalid source dataset 'C:\\Users\\myuser\\Documents\\Development\\FME\\UPLOADFOLDER'. No file operations will be performed for this feature Many thanks, Sam
Hello everyone,Is there a way to drap a 2d surface or polygone into a 3d surface (like in the picture joined). If there is in which format do we need the surface and polygone to be? Thank you in advance
I am using a SchemaScanner to prepare a dataset for dynamic writing to a PostGISWriter. How do I write to the columns for PrimaryKey and Geometry in an dynamic environment?
I want to turn my vector layer into a raster layer and then back into a vector layer to simplify it. When I used NumericRasterizer, I grouped my layer by category, but when I convert it back to a vector layer, it's not working. When I tried to rasterize it without grouping it, it worked fine, but I lost the attribute I was interested in.
UPDATE: Managed to figure out what went wrong in my comment below the main post (TLDR: Used the wrong transformer and field value from my dataset) Hi, so I'm trying to convert my annotation layer in my GDB files along side the point, polygon and line layers into DWG. In my screenshot of my ArcGIS Pro instance, you can see the various labels above my polygons.But it looks like only 2 of them passed through to DWG when converted through Workbench.In my current workspace I'm using a LayerTypeField field in the attribute table of all of my layers I wish to converted to sort them into the correct flows (Points, Polygon, Lines, Annotation).Those values are exposed via an AttributeExposer parameter as you can see here:The annotation layers are very basic ones that are created from running Convert Label To Annotations within ArcGIS Pro itself and an additional field added that just contains "Annotation" as text for filtering purposes in Workbench (LayerTypeField). At this ju
I have a point array of addresses, and a line geometry layer of streets, and I need to be able to get the ID of the nearest line to the point that also has a couple matching attributes. What are the best options to consider?