Data

I have a request to build a FME workspace that can read a text file and load it into an Oracle database with the filename with a suffix appended as the table name (ie. filename_ext).That is fine, the problem is the column headers and fields will differ, depending on the filetype (file A might have 10 columns, file B will have 17 and the column names will be different between A and B)I’ve considered using a tester that directs the flow to an attributemanager based on a “user parameter”. This becomes problematic if the source text file changes column structure or an additional file type (file C, D and E) is introduced.Is there a way for the text file to be read (as generic in the featurereader), have the attributes exposed, split and output with the 1st row as the column headers. Ideally without having to know the column names prior.Thanks Thomas

Hello FME Community!I’m trying to read a Civil 3D file in FME, but I’m not able to access the specific attributes I need.I'm trying to retrieve Pipe and Structure Data Fields (Attributes), but I'm running into errors. Here are the errors that I’m seeing:```2024-10-27 15:13:47|   5.1|  0.0|ERROR |AutoCAD Reader: An error occurred for dataset 'C:\Users\Dor\OneDrive\Perach\Ayalon\חומר ראשני\R6407_01-RME-DR-SVD.dwg', in function AutoCAD2004Reader::readC3DSchema. Exception thrown: 'Not that kind of class' (Object of class AcDbProxyObject can't be cast to AeccDbNetworkPartDef.)2024-10-27 15:13:47|   5.1|  0.0|ERROR |An error has occurred. Check the logfile above for details2024-10-27 15:13:48|   5.6|  0.0|ERROR |Failed to obtain any schemas from reader 'CIVIL3D' from 1 dataset. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information.2024-10-27 15:13:48|      |     |ERROR |Workspace generation faile

I have a dataset that has customer data, vehicle data, planned driving distance (with a bunch of other scrubbed attributes).  In this data, there are many days when a customer was not planned to have accumulated any distance but did use a machine.  If the planned driving distance to date is missing, I want to copy the value for the previous planned_Driving_dist_to_date that has a value, but I want this sorted by date and grouped by customer and machine.   The attached spreadsheet shows my dataset. 

Hi,I'm using the Raster Mosaicker to create a mosaic with overlapping images. However, the final result generates 'shadows' as shown in the image below. What is the best configuration or additional transformer I can use to solve this problem?Thank you 

When writing to Geotiff I would like Band interleaved by Pixel (BIP, interleaved RGBRGB) rather than Band Sequential (BSQ, per channel RRGGBB) interleaving but whichever option I use, the Geotiff always saves using Band Sequential interleaving.I have checked using Photoshop and also GDALinfo and both agree that INTERLEAVE=BAND rather than PIXEL. Is this a bug/can anyone else replicate this?

Hello :)Here is what I am doing: I am working with FME-Flow and FME Workbench 2023.1.1. I have geodata in the form of .csv-files and am using a simple CSV-Reader ➡ MSSQL-Writer to create my datatable in my MSSQL-database (see attached image for FME-script). The datasets are saved to the ‘dbo’-schema and work without problem in GIS (QGIS in this case). This is done for a number of CSV-files. As an example I have shown the summary annotation for the dataset ‘ov_boende_aldre’.What’s the issue? When FME writes to the MSSQL database, the resulting datatable(s) is/are not recognized by the systems view ‘geometry_columns’ (se image below). Why not? When creating a dataset directly in MSSQL or in GIS (QGIS, for example), the dataset appears in said systems view. What can be the issue here? Any secret sauce to make FME create the dataset correctly that I am just missing?All help and hints are appreciated. Also, if you are aware that there is a similar post with a solution then do please direct

Hello,I am creating buffer polygons for points, but I would like to loop through the newly created buffers and associate them with subsequent points that fall within the new buffer.If 2 points are next to each other, the first point would be buffered and the second point would be associated with that buffer.Thank you.

Hello ,How could i convert Geospatial Electrical Network Data (includes stations, cables , houses) are connecting to each other to convert these data as compact Block diagram .it is not important the coordinates ,I need to create a simple block diagram  of electrical data .I would like to adjust the positions of elements by bringing them closer together without overlapping and create the suitable connections between them .Is there any idea that I should to test ?FME 2021thanks in advance .

Hi, I'm trying to dynamically create the line drawings in a GTFS, that is, I want to create the shapes table, which is empty by default. I thought that it must be possible to do from the stop_times table, the stops table and the 'mother' lines in kml that contain the total theoretical route of each line. With stop_times I can know all the patterns that each line has (starts and ends) identified with stop code. patterns from stop_times.txtstops.txt, with coords The spicy part starts here. I should cut the parent line by start and end, keep the correct segment - I don't know how to identify it - and reorient it in case the 0 vertex of the line doesn't match the stop coords origin The thing is, I don't quite know how to do it. Any help would be appreciated. Thank you very much!Pol PD: I cannot attach KML on this thread. ‘Mother’ lines comes from there:R11: https://www.google.com/maps/d/u/0/viewer?mid=1Oovi7a-WCKVFI_h4IigcGDBCXPo&femb=1&ll=41.91271293489377%2C2.6520825662537018&amp

Hi I am compressing LAS to zLAS with ArcGIS Interoperability.One of files is huge - 2700 million points and 89331057kb Software stops to write fail in folder without any comment at written file size 25Gb (Error running translation). There are no problems with disk space and memory! FME_TMEP is configure properly in 4Tb SSD store. Computer have 64Gb RAM.I am do this translation twice, but result is same and file size is same.Is it ESRI limitation on zLAS size, or something else?Best regards,Arvid

Hello,I have built a workspace in Workbench 2022.2.4 that reads a specified shapefile (e.g. 10_18_24_line_review.shp) from a folder titled C:\New Shapefiles, performs some basic transformations (datetime stamping, attribute formatting, spatial relation, filtering, etc.) writes out two new resulting shapefiles (with naming conventions based on the new ‘_timestamp’ field) to a folder titled C:\Outputs, then moves the original shapefile being read into a C:\Completed folder using the FILECOPY writer.What I would like to do now is:Configure the workspace to read in any single zipped shapefile that I place in the “New Shapefiles” folder. Scilicet, the naming conventions of the zipped shapefiles I receive will not be consistently predictable, but only one will be in the “New Shapefiles” folder at a time.To clarify: my vision is to drag and drop a new zip of a shapefile (containing concomitant files [e.g. .dbf, .prj, .shp, and .shx]) into the empty C:\New Shapefiles folder, open my workspace

Hi,How can I expose the result (print), like attribute in python caller:         from_value = min_iten[0]['from']        to_value = min_iten[0]['to']        print(f"{from_value[:-10]}") Thank´s

Hi together We have a problem by writing mulriple cable data into a fgdb. The process runs once per cable and writes their information into a fgdb, the process is repeated for each cable, stored in a csv list. Now we have the problem, that the next cable in the list is overwriting the previous one in the fgdb, instead of getting appended. We assume, that the problem lies in the writer configuration, but we don’t find a solution to our problem. Is it possible to append data to existing data in a fgdb or do you have any ideas (like Python skripts, other transformers that could append the data of each run etc...)? Thanks for your support

Hi FME folks,Is it possible to sort the column names in the Table View in the Visual Preview alphabetically?It's frustrating to have to scroll all the way to the right to find a column that starts with an “a”... Thanks!

Not sure why this is possible, but in the FGDB Writer it is possible to create a coded domain into unlimited coded domain.No idea what is the point of being able to do this, because in ArcGIS this is not supported at all. Well, maybe there is something new I missed from ESRI. But yet I can’t see in ArcGIS Pro the SECOND_CD I created.Anyone could tell me what is the purpose of doing this ? What am I missing?I’m on FME 2024.1.Thanks!

Hi,I have a workspace that uses some RasterToPolygonCoercer, but the performance is very low.I need to improve the performance. I'm trying to convert some clouds detected in my raster image into polygons.How can I improve that? Thank´s   

I am new to FME Workbench and I am using the latest 2024.1 version.When I tested to add CSV to ESRI ArcGIS Portal as a new point feature layer, it succeeded to create a new feature service in portal but failed to insert CSV data into the newly created feature service with following error message: “ArcGIS Portal Feature Service Writer: UPSERT failed for feature service 'Sample_Test': Append job failure: 'Operation rolled back.'”Then I have to re-run my workbench again, and this time it will insert all CSV data into the portal feature service without any issue.BTW, I am using “Create If Needed” as Feature Service Handling parameter.Could someone help me out to make this workbench adding CSV data to ArcGIS Portal in one process? Thanks.   

Hey,There is one blog on support.safe.com on working with esri shapefile data. There is a scenario and below explained the workspace attached to it.I am not getting how the Shapefile is created in below scenario. The shapefile was already given in the template file.Below is the link of the article - https://support.safe.com/hc/en-us/articles/25407430413837-Tutorial-Getting-Started-with-FME-DesktopHow the esri shapefile used in the reader is created? Thanks in advance

Hi,I understand that the Raster Expression Evaluator transformer doesn't work properly, only in the new version 2024.2.I would like to know how I can proceed with my workspace, as I want to keep only the raster pixels with values greater than 0.3. How can I solve this? Please find my sample attached: https://drive.google.com/file/d/1Yil9aZj5mkiTQi7lbvDJfFejWKQE4YTl/view?usp=sharing Thank´s

Hi,  I have an excel spread sheet that i have to read and load into a database table. The structure of the excel sheet is different from that on the database. Sample screen shot of the excel spread sheet is seen below. Columns J-S are county names, and the values associated with it are the cost for each county.I need the 10 county column names loaded as values into COUNTY_CD column in the database and its associated county cost value loaded into database column COST_PER_SQFT. So, for every row in the excel spread sheet I will have 10 rows in the database and each row represents data for each county. The database columns and the values to be loaded should like belowI had looked into several post that does transpose of columns, pivot tables etc, but I couldn’t find a solution that works for me. Any help is much appreciated!  Thank you,lsugumar.

HiI have a DGNv8 3D CAD drawing of a bridge i want to load into FME since i have been tasked with converting it to a different format.The issue is that not all parts of the bridge loads/reads properly, most notably the deck of the bridge is missing. Most of the bridge is drawn using smart solids.Here is the bridge in MicrostationHere is the bridge in FME. All i have done is add a reader and an inspector.And if u look at the feature information for those missing parts it says nan. I have attached the dgn file in a zip file. I hope some can help me or confirm that it is not possible in FME.Thanks for taking the time to read my question.  

I have a kmz file. There is a point in it. When I open the kml file with fme, the screenshot is attached where it converts the geographical latitude and longitude from degrees minutes to decimal. Additionally, degrees have been converted from minutes and seconds to decimals by Tubitak, the leading institution in Turkey. The screenshot is attached. Does anyone know the reason for the difference? 

I need the coordinates of the intersection, where lines cross the railroad geometry.With SpatialFilter/SpatialRelator I can isolate the lines (from a larger dataset than shown here). But I cannot identify the coordinates of the intersection.In the drawing the red dots are the points I need, they are handdrawn for explation.Any ideas as to what I could do?Thank you :)  

Hi FME fans, I am using the MS Sharepoint List writer to update values - this is using Feature Operation 'Update' using Row Selection 'sharepoint item id'.This works fine when I give it a new value, eg a different date, however if I set the value to null in FME the value in sharepoint doesnot change. How can I set the value to null?Thanks, Owen

Hi,I have a dataset with 8 images. Look below at the images together: After using the Raster Mosaicker, the output is 1 image like this: What could I have done wrong in the transformer, or what else is necessary?Thanks.