- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,807 Posts
25,077 Replies

When you subscribe we will email you when there is a new topic in this category

6807 Posts

lisaonmsnContributor

Writing SQL Server views to Excel works with database connection A fails with database connection B?

I have an .fmw that reads a series of SQL Server views then writes the returned values to a templated Excel spreadsheet and it worked while using our DEV SQL server (A). When I replace the existing database connection to verify it works on our Production SQL Server(B) the value in one cell is missing in the Excel spreadsheet. I get 0 errors, 0 warnings using (A) or (B) connection. All the remaining view results are there and correct. Verified that the SQL VIEWS exist on both servers and refreshed both just in case-same results. I can select the views via SSMS and get the correct data on (A) and (B). I tried deleting the one failed writer and re-adding it: same results.I tried deleting the reader supplying the view information and re-adding it: same results.Thoughts? Using FME Form Desktop Version 2023.1

131

4 months ago

adamleeContributor

asked in Data

Looping through list of email users and sending email

Hi, I have a process that im unable to get working and wold like advice on the processesI have a dataset containing a number of records, each with a user and their email address. There are multiple records for each user,The requirement is to identify each unique user in the data and send them an email detailing all the records relating to them. The users could change each time the process is run so i havent set any filters with their names.My thoughts were to create a loop to go through a list of users, filtering their records out and sending the email before moving onto the next name on the list.This would keep going round until there are no names left in the list.I have used the statistic calculator to identify the users and have used the HTML report generator and emailer for the the end of the process but would like some help explaining how the loop should be set up (if this is the best way to do it) and how i can move to the next person in the list each time. Thanks

773

4 months ago

marjan_nikoukarContributor

asked in Data

Expand address ranges including number and letter in FME

I have and CSV address data file. There are address number ranges that I could expand it with the help of bruttino. Using Cloner and attribute manager transformers.I need to do another clone and need your assistance.I also have 2 fileds: “Street Address Number Suffix From Code” and “Street Address Number Suffix To Code”. For example, from A to D I need to copy based on the number of suffix between From and To, then replace the current suffix. like A, B, C, and D for this example. I also have 2 fields: “Suite from Number” and “Suite To Number”, which are combination of number and letter. For example from 2A to 2D.I need to get a result like 2A, 2B, 2C, and 2D.Do you have any idea how to handle these fields? I really appreciate your assistance.

Regex preview highlight bug

The preview highlights the letters Op but the Regex only replaces the quotes (as expected): Result:‘Op. test ’ will become _Op. test _

koenvdwContributor

Hi I have a shapefile representing image footprints with as attribute the image name.I have a shapefile containing multiple polygons with an attribute ‘name’ representing buffered lines. I have a workbench that selects all the image footprints per line and copies the images to a folder, fanned out with the line name. It does that perfectly, but some images exist in multiple lines and my wb only copies the image to the first line and doesn’t copy it to the other lines. How can I solve that?

647

4 months ago

vanessarapiorContributor

asked in Data

ORACLE_HOME is not set

Hello,I installed FME 2022.1.1 on my laptop and installed the Oracle client (11_2) but even after several reboots I cannot select any Oracle Database as reader. They are all greyed out. When I open a workbench that contains Oracle it says something about missing dependencies: ‘Oracle Non-Spatial’,Oracle Spatial Object’. When I want to run it, it fails and gives the error: ORACLE Home is not set. Does anyone has a hint how to fix that?

852

4 months ago

mar-garitaParticipant

asked in Data

Performing bulk Portal feature service updates using FME

I need help performing bulk feature service updates using FME.I would like to do what this blog post is doing, under the section "Updating AND Deleting Database Records with FME" but I can't recreate the steps with a feature service in Portal since there is no Row Selection option in these writers. The blog has steps to write to another geodatabase.Essentially, I need to update floorplans data by deleting the old version of the floor plan in the feature service and replacing it with the new floorplan data.The updated floorplans data exist in a geodatabase and it is used to update a feature service in Portal via ArcGIS Pro.Right now, I manually select all the floors that match the LevelID (unique ID we use for each floor in a building) in the update layers.Then, I delete all the features that match and insert the new features into the feature service, using the field mapper to populate necessary attributes.Any advice or help is appreciated. Thanks.

531

4 months ago

keithoContributor

asked in Data

Read Embedded OLE Object from DGN

Using FME Form 2024.0 and DGN v8Hello All,I have a DGN file with an OLE Embedded Excel Object. I am able to locate the element that represents the OLE object and can return all the typical IGDS information about the element itself, size, layer, model its in etc. What I would really like to do is investigate tabs, rows and columns content within that embedded Excel. Does anyone know if there is a way for FME to read an embedded Excel object from a DGN file?

342

4 months ago

jasperwisEnthusiast

asked in Data

DWG Writer - Raster - set img path as a proper relative path

HiI would like to add a raster to a DWG and have the path to this external reference set as a proper relative path.When you write a raster to a DWG file, the AutoCAD writer automatically writes a PNG in the folder of your output DWG.If you keep this PNG file next to your DWG, it will always open. However, if you insert this drawing in a new drawing, the link to the image breaks.This is caused by the path of the external reference (raster) that is not properly set a relative path.If we look at the created path from FME in Autocad, we see this:If you change the path type to relative in autocadThen the saved path changes to: I have tried to copy this in FME, but no effect:Any ideas?Jasper

522

4 months ago

parkerrParticipant

asked in Data

How to edit CAT reader parameters after I creating new one.

I have created over 200plus parameter fields and the alignment is off but can’t edit them. Not sure how to do this. I’m new to FME Workbenches and can’t see a way to update this. I’m using the CAT so that these fields can be ran into ArcGIS Pro. I have a huge workbench and not sure what to do next. I would love any help.

Is FME able to read Civil 3D alignment station labels?

I'm seeing the following lines in the Translation Log:AutoCAD Reader: Entity type of 'AeccDbAlignmentStationLabeling' found, but not supported. Skipping entityAutoCAD Reader: Entity type of 'AeccDbAlignmentMinorStationLabeling' found, but not supported. Skipping entityI'm reading a .DWG in as an AutoCAD Civil 3D format file. Am I interpreting this correctly that station labels are not supported by FME?

mr_fmeEnthusiast

Hi,How can I calculate NDVIRe, using RasterExpressionEvaluator? NDVIRe=Band 8 (NIR)+Band 5 (Red Edge 1) / Band 8 (NIR)−Band 5 (Red Edge 1)I don´t know to configure the transformer properly… Thank´s

9valParticipant

Hi!Is it possible to backup a PostgreSQL database (or a specific table) using FME?

632

4 months ago

mr_fmeEnthusiast

asked in Data

Raster to polygon some pixel value

Hi, I have one SCL band from sentinel II and would like to convert in polygon pixels with value 3 and 9. How can I do this using FME? Thank´s

402

4 months ago

offi24Contributor

asked in Data

Clip Point cloud with 3D Polygon

Hi,I want to clip a point cloud with a 3D Object (Box). The 3D Object has z values and should overlap the point clouds. Now when I am using the Clipper, I recognize, that the point cloud is not overlapping the 3D box, because it is not using the z values. How can I proceed in this case, that both have the same elevation and that the clipping is working?Point Cloud on the correct elevation of 280m. 3D Object at the ground (not using its z-CoordinatesThanks in advance

392

5 months ago

marjan_nikoukarContributor

asked in Data

Expand address ranges in FME

I have address data in CSV format. there are address number ranges, street address from number and street address to number, and sequence code (1 for odd, 2 for even, and 3 for consecutive).I need to expand these ranges into individual addresses based on sequence code and write them in a new CSV.Any guidance for doing this task in FME would be appreciated. Thanks

koenvdwContributor

Hi I have a workbench that I use for making ortho photo’s. I’m using this same workbench for over 4years now and since last week I’m getting always the same error. It’s says: jpeg2000 writer: Could not perform compression. I don’t know how to solve this, as it has worked always before… I installed the lastest FME form yesterday. I get the same error. I don’t know for sure, but one time I looked at the edit header option under tools to solve something, but I don’t think I changed anything. Could that result in this error?

865

5 months ago

mferwerda3Contributor

asked in Data

Creating XML for impoting Named Connections for ESRI ArcSDE Geodatabases

I have a lot of SDE connection files that I would like to create named connections for in FME Form 2024.I would like if possible to automate this by creating an xml file to import. I can use the Directory and File Pathnames Reader to get the path and the name for each sde connection file, so I am thinking I could use FME Form to create a xml file with all the entries I need and import that into the fme_userconnection.data filer whiteout having to do this manually one by one.I do not need to specify anything special in the connections, version, credentials etc. can all be defaulted, so the 2 values I need are the path and name, which I can get. I tried making a single conn and then exporting to see the xml format, but al the values are encrypted. Is there any kind of xml template or example xml I could use to see how to do this ?

jatoxaContributor

What happened to Revit appearances in 24.1? Or did I miss some new setting? 2023.224.1

352

5 months ago

messagemauriContributor

asked in Data

Dynamically read and nd create an sde table

Hi All, First of all, thank you for taking your time to read this post.FME Desktop 2022.2Objective: Using the Feature Reader I’m trying to dynamically have a user input an existing sde table name (so the user is prompted to insert the table name that already exists), then I have a reprojector followed by the FeatureWriter to Drop and Create the table in a new projection. The table to be dropped an create will be the same one inserted by the user. Hence, this table already exists. Error: ‘Feature Type Definition {feature here} was requested, but not defined’. I checked another similar post, but I still can’t get my workbench to work. I have a Feature Reader set as follows: When I run the workbench, the FeatureReader does not show the table name that was inserted by the user, but instead, it catches the table records under ‘Generic’ see screenshot below. (If I were to access that table statically (connecting to the table via the SDE connection), then the table name will display along w

302

5 months ago

messagemauriContributor

asked in Data

Dynamically read and write an sde table

Hi All, First of all, tanks for reading my post. FME Desktop 2022.2Objective: Using the Feature Reader I’m trying to dynamically have a user input an existing sde table name (so the user is prompted to insert the table name that already exists), then I have a reprojector followed by the FeatureWriter to Drop and Create the table in a new projection. The table to be dropped an create will be the same one inserted by the user. Hence, this table already exists. Error: ‘Feature Type Definition {feature here} was requested, but not defined’. I checked another similar post, but I still can’t get my workbench to work. I have a Feature Reader set as follows: When I run the workbench, the FeatureReader does not show the table name that was inserted by the user, but instead, it catches the table records under ‘Generic’ see screenshot below. (If I were to access that table statically (connecting to the table via the SDE connection), then the table name will display along with it’s schema defini

1132

5 months ago

ireenContributor

asked in Data

convert lines to gpx-files, fanout by name of the route

I have a feature class with cycling and walking routes (with ID and Name) and a feature class with the starting points of the (circular) routes. I want to write all the routes in the feature class to separate gpx-files. Each gpx-file should have the name of the route in its filename.I tried with the ‘fanout’ option in the writer, but the resulting files are no gpx-files and are very small (1kB), so without content I guess. Any advise?

DGN lines to infinity

I try to read a dgn file using FME and have some special results. The data is in epsg:28992 (Netherlands RD new) which is in meters. But it reads lines with the following coordinates:189492.31655848716, 348069.1188694655, 28.224907750701906 1.7976931348623158e+304, 1.7976931348623158e+304, 1.7976931348623158e+304 189492.31740355192, 348069.1195426307, 28.22490763540268 189492.31655848716, 348069.1188694655, 28.22490775070190The second coordinate seems to be very far off and not correct. I am able to delete the points from the lines which are that far off, but I wonder if anyone knows this as a bug, a feature or a setting?Thanks for looking,Niels

333

5 months ago

guydaenenParticipant

asked in Data

MariaDB reader error for MysqlDB with Latin-1 encoding

When I try to connect to a MySQL DB I get an error message related to the encoding format of the server. As I’m not an admin I can’t change the encoding of the Server. How can I solve this issue in FME Desktop 2022.2.---------------------------Fetching Feature Types Error---------------------------<b>Failed to retrieve feature types.</b><p>MySQL: the MySQL server does not support the utf8 encoding. Aborting translation---------------------------Close --------------------------- Thanks for helping me out. Kind regards,Guy

383

5 months ago

datatoadContributor

asked in Data

Export by Polygon Selection

Hey all, I am very new to FME and this may be a basic question, But I currently can’t find the answer elsewhere so I figured I would post and see if anyone can point me in the right direction. Currently, I am exporting from a GE small world database and moving the data to a FGDB for data analytics in other software. This is a complete export of all available data. That much I have been able to figure out with a few minor transformations. What I can’t yet figure out is how do I export only a small portion of the database. Say by a predefined polygon within the existing data set. For example My DB crosses a number of contiguous cities all having a defined boundary within the drawing. How do I tell FME to select and export only the lines and other objects within the city boundary of interest and excluded the data within the other city boundaries? Ultimately I need this breakdown so I Can export this to AutoCAD since the full DB is entirely too large for one drawing. Any help is apprec

754

5 months ago

Page 11 / 273

Badge winners

gazmanhas earned the badge Welcome Back
miguelhacarhas earned the badge Spanish Speaker
miguelhacarhas earned the badge Student (Grey)
miguelhacarhas earned the badge Expert (Grey)
miguelhacarhas earned the badge Teacher (Grey)

Show all badges

30,351: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.