Using readers and writers to extract and load data.
Recently active
Hi,We are trying to use a FileCopy Transformer to transfer files from one location to our server (synology) / other computers (other computer).If we do it in Ubuntu GUI / SystemCaller command it works perfectly.But the file copy transformer always give error messages as we don’t have sufficient permission. Even if I put our NAS credential in the transformer (with a featureWriter), it give the error messages. The files are created in the server but there’s no content inside.Does somones already experienced it ?Thank’sSam
Hi community,how can I set a NoData value for the pixels that are located outside my geographic area of interest?Attached you can find a GeoTIFF file:https://we.tl/t-XjrxojSLZhThanks! 🙏
Hi, I’m trying to generically read some tables and distribute them into different DWG Object Data layers. For this, I have a mandatory attribute containing the output layername.I use a SchemaScanner with a Group By on this attribute to generate the schemas and finally write everything using a dynamic DWG Object Data Writer.But it doesn’t work, I get a Layer 'XXX' is not definedBut(bis) if I use another DWG writer (e.g. RealDWG) with the exact same configuration, it does work.I guess the difference comes from the Object Data table definition? But I have no idea how to do that. I’ve tried to sort schemas and features to make sure that the schemas arrive before the features but it doesn’t change anything.When using the RealDWG Writer, if the parameter Output Schema Before Data Feature is set to No, I get the same error, but once set to Yes, the file is written without problem. What should I change when working with a AutoCAD Object Data Writer? Any help appreciated. Best Regards, Julien F
Hello, I am using FME Form 2024.1 and have the Esri ArcGIS Connector Package (version 3.11.3). I am experiencing some weird datetime functionality. I have a Portal Feature Service Reader (old school) in my workspace and would like to upgrade it to the new ArcGIS Feature Service Reader. Setup was great and reading the data worked well, but I noticed that any datetime attributes that come through are now being read differently. I have attached two screenshots of two datetime attributes that are being read differently depending on their Reader. The old version looks correct, you can generally start to make out the date for a feature (20250906), but the new way of reading looks completely different.Is there a setting I missed when setting up my new reader, or is this some new format? At first I didn’t notice this, but when I went to write the data back to Portal after passing it through my workspace, I got an error regarding these attributes (basically saying they were invalid)DateTimeConv
Question:I need to generate a square georeferenced PNG where: the interior of a geographic region is transparent, the exterior is filled with a solid color (e.g., gray). Currently, I have two geometries in EPSG:2056, which I merged using a junction node.How can I produce a single georeferenced PNG with these properties?I’ve attached my script and the two input files.
hello , How to use textures for different meshes of the same model in the PythonCaller converter?
I have a point layer, and within this layer I want to search around each point for those that are within 5000 m. For this, I used the Neighborfinder with "candidate only." It outputs a list with points that sometimes have 8 neighbors. In this list, I would like to keep either the initial point or the neighbor with the highest value in the TEST field. I'm stuck. I attached an image of the result and circled in red the points I’d like to keep.Moreover, the Neighborfinder transformer says it does not compare a point with itself, but I notice the opposite. Could you please help me?
Hi,I’m trying to modify the output file of a workspace using a Python shutdown script before it’s caught by the download service (or after, but before downloading). Is there any way to do that?The configuration is:workspace creating an output text file (interlis) workspace added to a Flow app with a download serviceI’ve tried to use the destination dataset parameter from the writer but without success. The script is :import fmedest_dataset = fme.macroValues['DestDataset_Interlis']with open(dest_dataset, 'r') as file: filedata = file.read()filedata = filedata.replace(',', '.')with open(dest_dataset, 'w') as file: file.write(filedata)Or if you have any clue on how to force an Interlis writer to use dots instead of commas as separator without changing the server locale, I’ll take that info as well. FME versions:Flow 2023.1.1.1 Form 2023.1.1.1 Best regards,Julien
Hello community,I am trying to combine 2 different images. DSM (GEOTIFF) : Band 0 (Real32) as heights 50 cm GSD Orthophoto (JP2): Band 0 (RED8), Band 1 (GREEN8), Band 2(BLUE8), Band 3 (UINT8 - NIR) 10 cm GSD My workflows looks like this: with following settings Unfortunetly there are some pixels where values get lost, so when I add an RasterBandAdder, there are holes in it.Unfortunetly I dont know a solution where I can add those two images into one without loosing informations.
I’ve seen both examples of creating KML:https://support.safe.com/hc/en-us/articles/25407754952717-Creating-KML-Folders-Through-KML-IDshttps://support.safe.com/hc/en-us/articles/25407609389453-Creating-KML-Folders-By-Feature-Type-FanoutI’m able to create folder structure:When I tried to add placemarks under subfolder, my folder structure gets overwritten. Subfolder has ID in the form of State and AssetType (minus spaces and special characters, you can see the ID below in folder name). Example, Alabama’s only plant asset has parent ID Alabama01Plant.What am I missing? Have latest FME 2025.1 Form.
Normally I use FeatureReader to import my datasets. This time I am dealing with a 4.5 GB GML dataset. What are the best settings to improve reading speed for my FeatureReader? Just like a general approach to use, reading GML file is just an example. I also other formats like .gdb, xml, json etc.I try to use the SpatialFilter when possible which makes the reading already more targetted. Hence, its switched this time also using my study area as Initiator.
I need to write my data into an MSSpatial database with a spatial index. However, when setting the SQLSERVER writer to the following then I do not get any spatial index generated. When I now go into SSMS to ‘clean up’ after FME Form then I face the issue that I have a column id of type identity, but it isn’t a PrimaryKey. Looking into the possibilities to set an index in the attribute definitions I can see that I set the index to ClusteredNotNull. I can also see there is no possibility to generate a ClusteredPrimaryKey, as it is necessary to create the spatial index. I assume I am going somewhere wrong here and would like to hear how I get my spatial index generated and applied when I am writing the data, instead of following up in SQL.
Is anyone else encountering vertices that are not displaying when Mark Coordinates is turned on in the Data Inspector? The coordinates are in the feature record, and display when I select them. Currently using FME 2025.1The features I’ve noticed this in have been donuts, and it’s the inner ring that is not appearing.
Hi,I’m struggling with reading JSON as a flat table, which I could use in GIS.I have the following JSON: I enabled option “Flatten Nested JSON Values into Attributes” but that produced one row with many columns. In some other post someone proposed a query json["collection"][*], but that also didn’t work.What options should I use to produce a flat table with JSON attributes as column names?
Hi there,I have created a Mosaic Dataset in ArcGIS Pro from downloaded 1m DSM GeoTIFFs. This displays fine in ArcGIS Pro. The boundary of the mosaic is clipped to the extent of the data I want to analyze. I need to convert this to LAS to run some ArcGIS GP tools. So I have done this using the Mosaic Dataset as an input in FME:Esri Geodatabase Raster → Point Cloud Combiner → LAS WriterThe output shows some incorrect data striping and looks like it missed some areas. In ArcGIS Pro:In FME Inspector:I don’t see any out of memory errors or issues with reading the Mosaic data in the FME logs.Any ideas?Thanks,Marc
Hi all,I am working on a script to replicate a set of feature classes from one enterprise geodatabase that we use for transactional editing purposes to another enterprise geodatabase that we use for publication purposes for the organization. This replication script would be scheduled in FME Server to run on a nightly basis.The issue is that the feature classes I plan on replicating have several domains and subtypes applied to them that don’t translate correctly.I’ve been advised to use the ‘Resolve Domains’ functionality and change the configuration from ‘coded domain’ type to ‘char’.My test workflow involves the below:Copying the feature class via the ‘Import Feature Class’ tool in ArcGIS Pro into the target Enterprise Geodatabase to have the feature class available in both geodatabases With FME:Selecting the ‘Resolve Domains’ checkbox in the Writer at the outset, and using the ‘Insert’ and ‘Truncate Existing’In the Writer configuration, changing the ‘coded domain’ type to ‘char’ and
Hi, I have a dxf file with objects in it, their representation is fine, I’m happy with it.However I need to filter these object using an polygon extent. So I read the dxf file using and Autodesk AutoCAD DWG/DXF reader and then lose the linetypes.The information seems to be read because an inspector shows me that the attribute autocad_linetype is correctly read (e.g. symbolLayer1), so it feels like the problem is that the style is not defined and thus FME uses CONTINUOUS in the end. Colors seem fine though. Is there any way to keep these types without recreating everything in FME? FME versions:Form 2023.1.1.1 Best Regards, Julien
Hi all,I have a CSV file containing stops with fields stop_lon and stop_lat. I’m trying to turn them into geometry and reproject them so I can use them with other layers.My workflow looks like this:CSV → Tester → VertexCreator → CoordinateSystemSetter → Reprojector In VertexCreator I assign X = stop_lon, Y = stop_lat. In CoordinateSystemSetter I set the source coordinate system to EPSG:4326. In Reprojector I reproject to EPSG:7856 (GDA2020 / MGA Zone 56). After running this, the points don’t land in the right place compared to my suburb polygon layer (which is already in EPSG:7856). In QGIS, both layers line up fine (on-the-fly reprojection), but in FME they don’t.Clearly I’m missing something in how I’m handling coordinate systems — but I can’t see where the mistake is.
Hi, I have a polygon that looks like it has some floating point issues in measures around 0. What is the best way to fix those values without affecting the legitimate values.I’m thinking extracting the measures as a list and then editing the list in python and resetting all the measures from the new list, but that seems a little convoluted.
I converted the fbx model to citygml format and opened it in KITModel Viewer, but encountered an error and the model did not display。
I'm trying to create a custom transformer 'FeatureCountLogger' which logs the number of features inputted into this transformer. The custom transformer contains a PythonCaller with the following code: import fmeobjects class FeatureProcessor(object): def __init__(self): self.featureList = [] def input(self,feature): self.featureList.append(feature) def close(self): logger = open(FME_MacroValues['Summarylog'], "a") message = FME_MacroValues['Message'] + str(len(self.featureList)) + '\\n' logger.write (message) logger.close() I want to use the logger multiple times, so I created a published parameter 'Message' in the custom transformer, so I can submit the text logged to each instance of the transformer. When I'm running this I get the following error: Python Exception <KeyError>: 'Message' It seems like the PythonCaller can't a
Hi,I am looking for a writter that will allow me to save blob data in FME Flow. On FME Form I am using AttributeFileWriter that is working completely fine
Hello Am struggling to combine geometry of an object . I should have 19 objects there is only 1 object which just doesn’t want to combine any unknown reason…..don’t know why ? Any suggestion / idea would be much appreciated. The reason i am combing objects is to extract the face of each object and then obtain FACE centre point for further analysis. thank in advance
Greets,I have two question: First one: how can I clip the green polygons based on the reds one with the same ratio?Second one: is there any way to move the red polygons to match the border of the green polygons. The Red and green polygons not in the same layer
In the stand-alone FME Form my FME script works well. However, using the same script in ArcGIS Pro faced error saying Esri Geodatabase Writer: Feature Type Definition … was requested, but not defined. A possible reason is that you may not have permission to create the Geodatabase. The error number from ArcObjects is: '-2147467259'. The error message from ArcObjects is: {}FeatureWriter or classical Writer, there is no difference. With other FME scripts (created by others) a fgdb can be created. Why not the mine?