Using transformers to modify data.
Recently active
Hi, I cannot convert Epoch time 1717500804837 to 20241210. I have change the format using @Evaluate(@Value(_created)/1000)and run DateTimeConverter but it failed Null, empty, or missing datetime was found. Enable the passthrough parameter to disable this What am I doing wrong?
After spending all morning trying to set up a Data Stream example in FME I think I’ve got it. It’s a basic geofencing setup:I have a GPX file of one of my bike commutes and use a WebSocketConnector in a sending workspace to send one location per second to a websocket.In a second, listening, workspace, that I’m running as a Stream, I’m using a WebSocketConnector to listen to that websocket and compare the locations coming out of that with a polygon. If it falls inside the polygon I then use a HTTPCaller to send me a message via Whatsapp.This is working fine:However, some of the documentation / tutorials I found, such as Websockets and FME Server, seem to imply that this should be possible with Automations too (and mention several other websocket transformers that have been deprecated). Has anybody tried that? Is this even a scenario where that would be useful? At one message per second, if I use the Websocket Received trigger and then the lisening workspace I end up with one new job bei
UPDATE 06/01/25: It does indeed appear that once created, the index is automatically rebuilt on writing to the GDB with truncate existing.Steps to recreate:Add SQL statement to create attribute index after writeCREATE INDEX <name_INDEX> ON <table_name> (<attribute_name>)Run the writer either to create new GDB or update existing GDB Remove SQL statement Continue to run writer as normal going forwards-----------------------------Hi all,This is driving me crazy trying to figure out. I have a GDB writer that builds an attribute index after write.CREATE INDEX <name_INDEX> ON <table_name> (<attribute_name>)Unbeknownst to me, each time I updated the data, an additional index was being created instead of overwritten which led to a bloated GDB and blown out write times. Note: The GDB table handling is set to truncate before write.I first went to using the below statement, but I was unsuccessful. ALTER INDEX <name_INDEX> ON <table_name> REBUILDThe
So, our organisation has a maintenance management system for our roads, which now for some reason, no longer works with geometry which has duplicate nodes within the same polyline. I’ve been able to narrow this down to two cases where our road polylines layer violates this rule:Some roads have duplicate consecutive nodes due to mapping mistakes, which I’ve fixed with GeometryValidator. Some roads (such as roundabouts and parking area outlines) have the same start and end node. This is where I’m getting stuck.The potential solution that I’m looking for is something that can determine the polylines with the same start and end point with a small tolerance (0.1m would do the trick) as I could only get GeometryValidator to work as expected with this tolerance, then offset the end node by a small figure (perhaps 0.5m) back toward the penultimate node. This way, the polyline still keeps enough of the line to be usable, but will work with the management system. But, I’m happy to note any other
Hello,I’m having problems trying to write into a Azure Storage Table using the Azure Storage Table writer.It works for all text fields read from CSV but not possible both from Parquet file or Oracle connection where I include also floating or integer fields. The error is always the followingMicrosoft Windows Azure Table Writer: Failed 'INSERT' for rows in table 'xxxxxx'. Server response: 'HTTP Error Status Code #400: 0:One of the request inputs is not valid.'Suggestions?Thanks in advance,Roberto
I have a harddrive full of data I need to turn into a good database, essentially.I'm starting with converting any shapefiles into feature classes. I know how to convert one shapefile into a feature class, but I'm struggling with multiples that live in multiple areas/folders.I've got two workspaces setup so far.One is a read/write on ALL information in the hardrive. It writes a CSV so I can see what data exists. You can see the PATH in the photo below to see the data this reads.The second is where my reader is set to read all .shp using the following to work through all "\\**\\*.shp" however this obviously does not read the underlying datasets that work together with a ShP to create it (.dbf .prj etc)The write is a Feature dataset and the second is just a GDB set to fanout. None seem to really do the job. Some export just a table, some just two feature classes.I'm not sure if there is more I need to do within the workspace to process Shapefiles. I can't see
I want to be able to use the feature reader transformer for scene layer packages (to combine multiple files) but the format doesn't seem to be supported at the moment. Are there any plans to include this format in the future?I have come across this request but it doesn't seem to have gained much traction:https://community.safe.com/s/idea/0874Q000000Tku4QAC/detail
HI i'm sure there is a very simple answer to the question. I have a polygon with many small holes in it that i want to remove.i'm running a DonutHoleExtractor followed by a tester to select holes <2m squared. i want to merge only these small holes to my main dataset (so only the larger "real" holes are left)i've tried running a Dissolver however this takes ages to run. can anyone think of another tool that would just merge these small holes into the larger polygons they touch?
Hi,I’m using XSD Driven XML Writer with XSD’s specified in schemaLocation. When I use absolute paths it works fine. When I try to use relative paths to the schemas I receive a error message.http://www.company.de/example file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsdEnds up in an error:XML Parser error: 'Error at file: '' line: 0 column: 0 message: unable to open primary document entity 'C:\Windows\System32/file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd''An error occurred while attempting to parse the XML Schema document 'file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd'No idea why System32 is there since my FME_MF_DIR should be c:\projects\myproject
Dear FME Community, I have a FME Form and also ArcGIS Pro license. I am new to IFC format and also new to FME Workbench. I want to view and work with the IFC Files in ArcGIS Pro and later publish it as a WebScene in ArcGIS Online.I do not have Data Interoperability Extension License for ArcGIS Pro. To achieve this i need to clarify below questions : Using FME 2023.2 and ArcGIS Pro 3.4.0How to convert IFC files to ESRI Geodatabase using Workbench ? Should i change the Coordinate system (Gauß-Krüger) of IFC files in order to view and work with the files in ESRI Geodatabase (ETRS89.UTM-32N) ? Which coordinate system should the output files have in order to work in ArcGIS Pro ?Please find the screenshots for more information.IFC Files with Coord.System Writer Format with Coord.System A detailed solution with working steps would be helpful. Thank you.
Hi,I created a simple StringSearcher in FME Form and want to use the resulting “All matches” list in consecutive transformers. I can access / log the results properly in FME Form. However, when I publish the workbench to FME Flow, the list isn’t exposed and cannot be accessed. Can You reproduce the behavior?RegardsStefan FME 2024.0.1.0 (20240328 - Build 24202 - win64)FME Flow 2024.0 (Build 24187 - win64)
Hi! I have been using the HTTPCaller Specify Upload Body to upload files to Saleforce. It has been working smoothly with only one problem, which is the size limit that can be uploaded via this method. Saleforce advises that I need to use Mutipart method instead. If I’m using Python, below is the data that I will be sending with Multipart method (basically I just wanted to upload this file called test.PNG):[('entity_content', b'\n------boundaryString\nContent-Disposition: form-data; name="entity_content";\nContent-Type: application/json\n\n{\n "ContentDocumentId" : "",\n "ReasonForChange" : "test upload",\n "PathOnClient" : "test.PNG"\n}\n\n------boundaryString\nContent-Type: application/octet-stream\nContent-Disposition: form-data; name="VersionData"; filename="test.PNG"\n\n'), ('VersionData', ('test.PNG', <_io.BufferedReader name='<file_path>test.PNG'>, 'application/octet-stream')), ('', b'\n------boundaryString--\n')] However I’m not sure how to populate those da
Using the same polygon the Generalizer (Douglas, tolerance=0) returns different results depending on the orientation of the polygon.Any explanation?
It appears the LabelPointReplacer removes the z-value from 3D point features and replaces it with NaN. I’m using FME Form 2024.0.3.0 as our IT-department isn’t fast enough with the updates 😑. Does anyone know if this is fixed in a newer version? Now I 3D-force it with the old z-value.
The three readers need to match up exactly. I would like to be able to see how many are perfect and how many need to be fixed. I would like the ones that don’t match to be dumped into an Excel spreadsheet that I can look at and make the necessary corrections. This is what I have so far. Top and bottom do match, middle one deliberately does not. What do I need to do and how should I proceed?
Hi, we have a dwg file and we wanna use this file in a gis software. We are aware that the fme cannot do georeferencing.Our approuch ist to use the Offsetter transformer to “move” the data to the correct place!That would be enough for us! So fist we used the AutoCAD DWG/DXW Reader to read the dwg file.Do we now have to set a coordinate system before using the Offsetter?Inside the inspector tha coordinates looks like this: Can anyone help us please?
I know there seems to be lots of topics around this but just can’t seem to get it to work.I have a configuration file that I read in at the start of a workbench. In that file is a range of attributes that I turn into user parameters.One of these is to define a specific field from a table which I have called _extractSubjectParcelQueryFieldHow do I use the contents of this variable to be the attribute that I want to expose? In my case the actual value of the user parameter is ‘land_id’ but this can change depending on the data coming in.
I have 2 coordinates in Denizli,Turkey . I have lang and long. Sample 2 coordinates :U1 37.787464° 28.780846°U2 37.751292° 28.864560° I use reprojector transformers convert the data wgs84 to ed50turkey. I use EPSG:4326 and EPSG:23035 .It converted wrong coordinate. The true coordinate of ED50 Turkey : U1 656858.976 4183906.006U2 664311.027 4180035.990 Thank you!
One thing wish FeatureJoiner had was a CROSS JOIN / Cartesian Product mode to create every permutation of Feature Set A vs Feature Set B (Eg. When creating To-From Lines between every possible Origin Point and every possible Destination Point).Custom Transfomer FeatureCrossJoiner is not anything really radical in how it gets FeatureJoiner to do this by creating a temporary dummy Cross Join attribute, but perhaps simplifies the process for some users.https://hub.safe.com/publishers/bwn/transformers/featurecrossjoiner
Hi,I have a fgdb, I want to drop all existing features classes within the fgdb and write in a new one. Is this possible?ThanksB
Out of the blue, I've started getting the below error message with my workspaces running on flow which talk to SharePoint: FME Flow error logI did some of my own digging, and found this community post:where the user had a similar issue. I have uninstalled my sharepoint package (1.1.6) and downgraded a version but it still doesnt work. I also upgraded it to 1.1.7 for good measure and that also didn’t fix the issue. I am not downloading these packages directly off of hub because my install is on a remote server, so i have to copy the packages across before installing. I know partial installs can occur doing it like this, but error came out of the blue and I’m not sure why. There was an OS upgrade on the remote server prior to this, but if something was inadvertently deleted, I would have thought that reinstalling the package would restore what was missing. FME Server 2022.2.5Build 22795 - win64 Thanks :)
Hi,I am working with CityGML data and using FME to process and transform buildings from a 3DCityDB into CityGML output. I know I can use the 3DCityDBImporter/Exporter for this but I would like to create a custom FME script for more control.I am trying to transform attributes from the 3DCityDB into a format suitable for CityGML output, specifically list attributes like citygml_function{}, citygml_function{}.codeSpace and citygml_usage{}, citygml_usage{}.codeSpace. These attributes are stored as strings with values separated by --/\--, and the corresponding URLs (codeSpace) are also in a similar delimited format.I attatch one building with these attributes in csv format as an example.The end result should be like this feature (building):Have anyone done something similar as this? Im not very used to working with lists. Would appreciate the help, thanks in advance!
Hi, I am trying to edit the workbench from https://fme.safe.com/blog/2016/05/point-cloud-power/ so it splits the polygon into the number of parts or area I provide. I cannot figure out how to change the PointCloudCoercer to allow me to do so
Hi there, I have a shapefile with real estates that enclose several buildings. I want each polygon in the real estate layer to inherit the attribute entries for the buildings that lie inside each real estate polygon. Some of these entries will be the same, but I want all unique entries for buildings within the same polygon to be written to the same entry. For example. Three buildings lie within one real estate with attribute entries “Residence” “Grocery store” and “Recidence”. I want these attributes entries to be concatenated into a single attribute entry, separated with comma, in the real estate layer, but with duplicate entries removed. So, the final attribute entry should be “Resicence, Grocery store” for the real estate polygon. Is there any way to achieve this in FME?
Hi All! Just a hopefully quick question: I want to write data to ArcGIS Online, and i want to do it dynamically, but it isnt really working out, here are my settings: I want to dynamically write data to ArcGIS Online, but i get this error message: Can someone tell what im doing wrong? Thanks in advance!