- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,783 Posts
24,947 Replies

When you subscribe we will email you when there is a new topic in this category

6783 Posts

Recently active

Most replies Most views Newest first

mr_fmeEnthusiast

asked in Data

"Shadown" in final Mosaic

Hi,I'm using the Raster Mosaicker to create a mosaic with overlapping images. However, the final result generates 'shadows' as shown in the image below. What is the best configuration or additional transformer I can use to solve this problem?Thank you

GEOTIFF Writer Interleaving Type option doesn't seem to work

When writing to Geotiff I would like Band interleaved by Pixel (BIP, interleaved RGBRGB) rather than Band Sequential (BSQ, per channel RRGGBB) interleaving but whichever option I use, the Geotiff always saves using Band Sequential interleaving.I have checked using Photoshop and also GDALinfo and both agree that INTERLEAVE=BAND rather than PIXEL. Is this a bug/can anyone else replicate this?

1133

27 days ago

nsmartParticipant

asked in Data

Reading CSV and Writing to MSSQL Database: tables not recognized by geometry_columns

Hello :)Here is what I am doing: I am working with FME-Flow and FME Workbench 2023.1.1. I have geodata in the form of .csv-files and am using a simple CSV-Reader ➡ MSSQL-Writer to create my datatable in my MSSQL-database (see attached image for FME-script). The datasets are saved to the ‘dbo’-schema and work without problem in GIS (QGIS in this case). This is done for a number of CSV-files. As an example I have shown the summary annotation for the dataset ‘ov_boende_aldre’.What’s the issue? When FME writes to the MSSQL database, the resulting datatable(s) is/are not recognized by the systems view ‘geometry_columns’ (se image below). Why not? When creating a dataset directly in MSSQL or in GIS (QGIS, for example), the dataset appears in said systems view. What can be the issue here? Any secret sauce to make FME create the dataset correctly that I am just missing?All help and hints are appreciated. Also, if you are aware that there is a similar post with a solution then do please direct

252

27 days ago

i_miss_the_chatContributor

asked in Data

loop through the newly created buffers and associate them with subsequent points that fall within the new buffer.

Hello,I am creating buffer polygons for points, but I would like to loop through the newly created buffers and associate them with subsequent points that fall within the new buffer.If 2 points are next to each other, the first point would be buffered and the second point would be associated with that buffer.Thank you.

341

27 days ago

gogopotter90Contributor

asked in Data

How to create a Block diagram of Geodata

Hello ,How could i convert Geospatial Electrical Network Data (includes stations, cables , houses) are connecting to each other to convert these data as compact Block diagram .it is not important the coordinates ,I need to create a simple block diagram of electrical data .I would like to adjust the positions of elements by bringing them closer together without overlapping and create the suitable connections between them .Is there any idea that I should to test ?FME 2021thanks in advance .

573

28 days ago

pcarrerabalsellContributor

asked in Data

creating shapes.txt from stop_times.txt, stops.txt amb kml line (GTFS) any ideas?

Hi, I'm trying to dynamically create the line drawings in a GTFS, that is, I want to create the shapes table, which is empty by default. I thought that it must be possible to do from the stop_times table, the stops table and the 'mother' lines in kml that contain the total theoretical route of each line. With stop_times I can know all the patterns that each line has (starts and ends) identified with stop code. patterns from stop_times.txtstops.txt, with coords The spicy part starts here. I should cut the parent line by start and end, keep the correct segment - I don't know how to identify it - and reorient it in case the 0 vertex of the line doesn't match the stop coords origin The thing is, I don't quite know how to do it. Any help would be appreciated. Thank you very much!Pol PD: I cannot attach KML on this thread. ‘Mother’ lines comes from there:R11: https://www.google.com/maps/d/u/0/viewer?mid=1Oovi7a-WCKVFI_h4IigcGDBCXPo&femb=1&ll=41.91271293489377%2C2.6520825662537018&amp

844

29 days ago

cochdpContributor

asked in Data

Read a new zipped shapefile (with any title) from a specified folder

Hello,I have built a workspace in Workbench 2022.2.4 that reads a specified shapefile (e.g. 10_18_24_line_review.shp) from a folder titled C:\New Shapefiles, performs some basic transformations (datetime stamping, attribute formatting, spatial relation, filtering, etc.) writes out two new resulting shapefiles (with naming conventions based on the new ‘_timestamp’ field) to a folder titled C:\Outputs, then moves the original shapefile being read into a C:\Completed folder using the FILECOPY writer.What I would like to do now is:Configure the workspace to read in any single zipped shapefile that I place in the “New Shapefiles” folder. Scilicet, the naming conventions of the zipped shapefiles I receive will not be consistently predictable, but only one will be in the “New Shapefiles” folder at a time.To clarify: my vision is to drag and drop a new zip of a shapefile (containing concomitant files [e.g. .dbf, .prj, .shp, and .shx]) into the empty C:\New Shapefiles folder, open my workspace

796

30 days ago

mr_fmeEnthusiast

asked in Data

Expose value Python Caller

Hi,How can I expose the result (print), like attribute in python caller: from_value = min_iten[0]['from'] to_value = min_iten[0]['to'] print(f"{from_value[:-10]}") Thank´s

342

30 days ago

areyiContributor

asked in Data

Append data iterative to a FGDB

Hi together We have a problem by writing mulriple cable data into a fgdb. The process runs once per cable and writes their information into a fgdb, the process is repeated for each cable, stored in a csv list. Now we have the problem, that the next cable in the list is overwriting the previous one in the fgdb, instead of getting appended. We assume, that the problem lies in the writer configuration, but we don’t find a solution to our problem. Is it possible to append data to existing data in a fgdb or do you have any ideas (like Python skripts, other transformers that could append the data of each run etc...)? Thanks for your support

191

30 days ago

ed-progresContributor

asked in Data

How to sort column names in Table View (Visual Preview)

Hi FME folks,Is it possible to sort the column names in the Table View in the Visual Preview alphabetically?It's frustrating to have to scroll all the way to the right to find a column that starts with an “a”... Thanks!

1046

30 days ago

philippebEnthusiast

asked in Data

FileGeodatabase - Coded Domain into Coded Domain ?

Not sure why this is possible, but in the FGDB Writer it is possible to create a coded domain into unlimited coded domain.No idea what is the point of being able to do this, because in ArcGIS this is not supported at all. Well, maybe there is something new I missed from ESRI. But yet I can’t see in ArcGIS Pro the SECOND_CD I created.Anyone could tell me what is the purpose of doing this ? What am I missing?I’m on FME 2024.1.Thanks!

364

1 month ago

mr_fmeEnthusiast

asked in Data

PolygonToCoercer very slow

Hi,I have a workspace that uses some RasterToPolygonCoercer, but the performance is very low.I need to improve the performance. I'm trying to convert some clouds detected in my raster image into polygons.How can I improve that? Thank´s

542

1 month ago

fei2000Observer

asked in Data

Failed to add CSV to ESRI ArcGIS Portal in one process

I am new to FME Workbench and I am using the latest 2024.1 version.When I tested to add CSV to ESRI ArcGIS Portal as a new point feature layer, it succeeded to create a new feature service in portal but failed to insert CSV data into the newly created feature service with following error message: “ArcGIS Portal Feature Service Writer: UPSERT failed for feature service 'Sample_Test': Append job failure: 'Operation rolled back.'”Then I have to re-run my workbench again, and this time it will insert all CSV data into the portal feature service without any issue.BTW, I am using “Create If Needed” as Feature Service Handling parameter.Could someone help me out to make this workbench adding CSV data to ArcGIS Portal in one process? Thanks.

1 month ago

poonam21Contributor

asked in Data

Create ESRI Shapefile from CSV

Hey,There is one blog on support.safe.com on working with esri shapefile data. There is a scenario and below explained the workspace attached to it.I am not getting how the Shapefile is created in below scenario. The shapefile was already given in the template file.Below is the link of the article - https://support.safe.com/hc/en-us/articles/25407430413837-Tutorial-Getting-Started-with-FME-DesktopHow the esri shapefile used in the reader is created? Thanks in advance

912

1 month ago

mr_fmeEnthusiast

asked in Data

How to filter pixel value - other way

Hi,I understand that the Raster Expression Evaluator transformer doesn't work properly, only in the new version 2024.2.I would like to know how I can proceed with my workspace, as I want to keep only the raster pixels with values greater than 0.3. How can I solve this? Please find my sample attached: https://drive.google.com/file/d/1Yil9aZj5mkiTQi7lbvDJfFejWKQE4YTl/view?usp=sharing Thank´s

332

1 month ago

lsugumarContributor

asked in Data

Load column name as an attribute value and column values loaded into another attribute

Hi, I have an excel spread sheet that i have to read and load into a database table. The structure of the excel sheet is different from that on the database. Sample screen shot of the excel spread sheet is seen below. Columns J-S are county names, and the values associated with it are the cost for each county.I need the 10 county column names loaded as values into COUNTY_CD column in the database and its associated county cost value loaded into database column COST_PER_SQFT. So, for every row in the excel spread sheet I will have 10 rows in the database and each row represents data for each county. The database columns and the values to be loaded should like belowI had looked into several post that does transpose of columns, pivot tables etc, but I couldn’t find a solution that works for me. Any help is much appreciated! Thank you,lsugumar.

352

1 month ago

simonlrContributor

asked in Data

DGN reader not reading all of the drawing.

HiI have a DGNv8 3D CAD drawing of a bridge i want to load into FME since i have been tasked with converting it to a different format.The issue is that not all parts of the bridge loads/reads properly, most notably the deck of the bridge is missing. Most of the bridge is drawn using smart solids.Here is the bridge in MicrostationHere is the bridge in FME. All i have done is add a reader and an inspector.And if u look at the feature information for those missing parts it says nan. I have attached the dgn file in a zip file. I hope some can help me or confirm that it is not possible in FME.Thanks for taking the time to read my question.

382

1 month ago

ienesaglam60Contributor

asked in Data

open kmz file error coordinates wgs84 latlon degree to decimal

I have a kmz file. There is a point in it. When I open the kml file with fme, the screenshot is attached where it converts the geographical latitude and longitude from degrees minutes to decimal. Additionally, degrees have been converted from minutes and seconds to decimals by Tubitak, the leading institution in Turkey. The screenshot is attached. Does anyone know the reason for the difference?

201

1 month ago

bkorsagerObserver

asked in Data

I need coordinates of intersection of two lines that intersect

I need the coordinates of the intersection, where lines cross the railroad geometry.With SpatialFilter/SpatialRelator I can isolate the lines (from a larger dataset than shown here). But I cannot identify the coordinates of the intersection.In the drawing the red dots are the points I need, they are handdrawn for explation.Any ideas as to what I could do?Thank you :)

Update sharepoint list

Hi FME fans, I am using the MS Sharepoint List writer to update values - this is using Feature Operation 'Update' using Row Selection 'sharepoint item id'.This works fine when I give it a new value, eg a different date, however if I set the value to null in FME the value in sharepoint doesnot change. How can I set the value to null?Thanks, Owen

mr_fmeEnthusiast

Hi,I have a dataset with 8 images. Look below at the images together: After using the Raster Mosaicker, the output is 1 image like this: What could I have done wrong in the transformer, or what else is necessary?Thanks.

502

1 month ago

lazarlubomirContributor

asked in Data

WORD (DOCX) TO PDF in FME ?

Hello everybody,I found many discussions about this topic, but, I just want to renew this discussion. Is there any way, how to convert word (docx) file to PDF format in FME, please?Thank You so much for all tips!Lubo

1718

1 month ago

bradContributor

asked in Data

Connecting to OS Downloads API via FME

Hello There, I’m hitting a brick walk with trying to get FME to talk to OS Downloads API, as anyone found any advice and guidance on this?

131

1 month ago

seanlegeerContributor

asked in Data

Trying to run a workbench in FME Server via Job Submitter and find the output.

Hello, we are trying to use our FME server to run all of our data conversion via the API. We have created a workbench and uploaded it. We set the service to Job Submitter. When we run it we can not see were the output was written to. The log indicates that job was run successfully but the log does not have any mention of an output location. We have tried to set the output File Geodatabase location to a network drive: “\\nos.noaa\MCD\FADS\FADS_Projects\FME_Workspace_Output\Weekly_Atons” and a local server drive: "F:\FME Server System share\repositories\Testing_Nate\ALL_USCG_Weely_Xmls_to_GDB\output\Weekly_Atons"Any help would be greatly appreciated

405

1 month ago

graysonContributor

asked in Data

copying values (ID) from intersecting line features to point features

Below you can see line and point features. Let's say each line segment has its own unique ID - in the example below, it will be from 1 to 6. I want to copy IDs from lines to poles that they intersect.According to my example, it would be:Point A: ID 1, 2, 3, 4Point B: ID 4, 5, 6 I have thousands of lines and points. What’s the best way to do it?Appreciate any help!

242

1 month ago

Page 3 / 272

Badge winners

changeofmotionhas earned the badge Teacher (Grey)
User15923979821343989192has earned the badge Welcome Back
ahmadrezakarimhas earned the badge Teacher (Grey)
oliverquirkehas earned the badge Welcome Back
johnthas earned the badge Student (Bronze)

Show all badges

30,142: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.