Skip to main content

Data

Using readers and writers to extract and load data.

  • 6,962 Posts
  • 25,627 Replies
6962 Posts
galigis
Enthusiast
galigisEnthusiast
asked in Data
Why is the FME area (Area Calculator) different to the ESRI GDB area?

Hi All, I have read a few posts on the community already but can’t understand why the area calculated using Area Calculator is different to the SHAPE_Area in the Feature Class after exported to a GDB. An example below: Any ideas why does this happen? Thanks :)

565
galigis
Enthusiast
tomf
Contributor
tomfContributor
asked in Data
Using functions such as @round() inside the XMLTemplater drops data

This is probably a simple question, but I'm having difficulty rounding values within the xml editor of the XMLTemplator. With the root template set to: <feature> <number>{fme:get-attribute("NUMBER")}</number></feature> The NUMBER value is written in the output. But when I use: <feature> <number>@round({fme:get-attribute("NUMBER")},3)</number></feature> or even: <feature> <number>@Evaluate(@round({fme:get-attribute("NUMBER")},3))</number></feature> the xml returned contains an empty string: <?xml version="1.0" encoding="UTF-8"?><feature> <number/></feature> I could round with an AttributeRounder prior to the XMLTemplater, but although that rounds the values in Visual Preview, the xml output can and does contain the floating point representation errors. I'm guessing this might be a syntax thing but I've had no joy yet implementing this in the editor. (FME 2020.1 b20620)

1146
debbiatsafe
Safer
marta.podsiad
Supporter
marta.podsiadSupporter
asked in Data
Civil3D drawing settting information

Hi, I have a Civil 3D CAD model and need to extract information from the Drawing Settings. However, the available data comes from the Drawing Units window instead , which can be very different from what’s in the Drawing Settings

463
daveatsafe
Safer
asali
Contributor
asaliContributor
asked in Data
Preserve Domain

Hi, Could anyone please guide me on how to preserve the domain as it is when a feature class with domain for multiple fields is read using SDE reader, and then when it is written to a SDE Writer. When i look at the fields of the output feature class, the domain is empty. How can i overcome this?

464
asali
Contributor
rzel24
Contributor
rzel24Contributor
asked in Data
How to INSERT '0' value as date using MariaDB/MySQL format

Hello, So I have been trying to INSERT a ‘0’ value date using a FeatureWriter with MariaDB/MySQL compatible format into our MySQL DB, but I can’t seem to be able to do it. I keep getting the message the row is skipped because an “Invalid date/time value”. I have tried using many different values for the ‘0’ date like ‘0000-00-00’ , ‘00000000’ with and without the single quotes but I keep getting the same behavior. I’ve also tried using different types of fields (varchar, date, datetime) in FME (but always keeping datetime in the DB) and still the same. I tried using 00010101 and that one was accepted and it did actually loaded into the DB without problems. In the DB the field is Nullable and also accepts cero values, but I can’t seem to get it to work from FME. Any ideas?. Thanks in advance. RZ.-

614
rzel24
Contributor
J
jecollins
asked in Data
MDB_ADO reader: An unknown exception occurred

Hi All, I am attempting to walk an FME script (using desktop 32 bit) over a large folder of specialised access databases called gINT files (.gpj) and move the data to various CSVs. However it will terminate after several hours with "MDB_ADO reader: An unknown exception occurred", and only write several of the CSVs for the files it has read. It works for smaller sample sets, so I don't believe it is a flaw in the script. I have a copy of the log, unfortunately it is a bit large to attach. Any help appreciated. Thanks -Jack Collins

407
neilmyoung
Contributor
simeon.simic
Contributor
simeon.simicContributor
asked in Data
Monitoring directory

I need help to make like something called monitoring directory. I have folder, its network based folder, and using FME form or FME Flow or both, i need to make next: Users will add CSV files in that folder, then that file or files will be add in postgreSql database. When users change file, it need to be changed in database too. When users add file , if the file with that name already exists in database , it needs to be replaced with new one

573
nielsgerrits
VIP
simeon.simic
Contributor
simeon.simicContributor
asked in Data
Copy multiple CSV files on PostgreSQL database

Hello, i am working on project and i need help.I want to copy multiple csv files from my pc, to postgreSql database.I have a folder on my computer and i want all files from that folder just to copy on postgre. I dont know how many files will be in folder on pc, so i cannot predict, but they all have some column names sames, some diferent, and some of them even have diferent number of columns So basically, i have set up a reader in FME workbench, in reader i selected which folder i want to read all csv files from, then reader is connected to schemaValidator , and that is connected on writer, that wrriter should write in postgresql My problem is that, when i run that workspace , in my postgre database writer writes right names in right schema with right data, but with columns from all files I need help, what can i do that if its exactly 5 files in folder that i read , that all 5 files in exactly how they are in folder to be copied on postgresql ? I have been try transformer FileCopy, but

654
simeon.simic
Contributor
zeliesch
Contributor
zelieschContributor
asked in Data
Problem reading data from ArcGIS REST feature service

Hi all! I am relatively new to FME but I work with ArcGis Pro since a while now. I am trying to add an “Esri ArcGIS Server Feature Service” reader, which actually contains multiple map servers hosted online on the open government website (public data). When I try to add the reader in FME, I get absolutely no visual preview of the data, it does not open in my window and therefore cannot interact with the data. Even though I get multiple warning messages, my translation log seems to indicate that mapping file generation was successful… Can anyone help me? Has anyone already dealt with that kind of issue? Is it an issue with authentification and authorization? Do you have pertinent resources concerning ArcGis features services as reader in FME? Thank you!

654
zeliesch
Contributor
kanteyemaodo
Contributor
kanteyemaodoContributor
asked in Data
DGN LInes câble TO SHP

j'ai un fichier dgn contenant les câbles de type polyligne avec leurs extrémités. -je veux extraire les câbles et les convertire en shapefile (.shp) avec les noms des extrémités.???

1146
kanteyemaodo
Contributor
tbarker1986
Contributor
tbarker1986Contributor
asked in Data
Extract DWG properties into FME (the equivalent of DWGPROPS in AutoCAD)

I'm trying to extract DWG properties into FME, the equivalent of the DWGPROPS command in AutoCAD. I have added an example screenshot below. The aim is to use this information wthin a workbench on FME Server. I couldn't identify anything in the AutoCAD reader that shows these properties. Does anyone have any solutions that would expose these DWG properties in FME? Any help would be greatly appreciated!

2155
emmaatsafe
Safer
fme_hans
Contributor
fme_hansContributor
asked in Data
save Geometry to a jpg file

Hi,I read sdo_geometry and make a cutout of a small area. I want to save this cutout as a jpf file. Is that possible?I do see jpg writers, but I suspect that some preparation needs to be done before you can save geometry data as jpg.

343
fme_hans
Contributor
offermann82
offermann82
asked in Data
Switch Esri Geodatabase Reader/Writer from traditional Versioning to Branch Versioning

Is it possible to switch the Versioning in an Enterprise Geodatabase (on SQL Server) from "traditional" to "Branch Versioning" without touching FME Workspaces containing Esri Geodatase Readers and Writers (GEODATABASE_SDE)? In a first attempt in the test environment, everything seems to be running like before, after we switched to Branch Versioning of our feature classes. A quick look in the geodatabase tables seems to prove that the internal fields like GDB_ARCHIVE_OID, GDB_FROM_DATE, ... are filled correctly. Can it really be that simple? Does FME support the switch to Branch Versioning while keeping the Workspaces untouched? Of course, this would be a dream, but this seems too good to be true.

3752
bruceharold
Contributor
rmpayaby
Contributor
rmpayabyContributor
asked in Data
How to add coordinate system to an IFC2x3-file?

I'm trying to update an IFC file by assigning it a coordinate system. However, FME doesn't seem to recognize the coordinate system used by the IFC2x3 file. I understand that the IFC file operates with a local coordinate system, but I don’t have information on which specific system it uses. I've attempted the following approaches: CoordinateSystemSetter Reprojector Setting the Writer’s coordinate system to WGS84 UTM33 Despite these efforts, the file always ends up with the coordinate system IFC_COORDSYS_0. Does anyone have a solution or a recommended approach to resolve this?

332
rmpayaby
Contributor
mattwilkie
Supporter
mattwilkieSupporter
asked in Data
How to update available EPSG coordinate systems?

The Coordinate Systems Gallery is missing EPSG spatial references we use all the time. How to update the gallery list so that more EPSG codes are available? (e.g. anything on https://epsg.io/)

2669
mattwilkie
Supporter
olivier
Contributor
olivierContributor
asked in Data
Uploading a file geodatabase to FME Server from the web interface

A user is supposed to use FME Server's web interface for running a FME workspace that has been published on it. That FME workspace takes a file geodatabase as input. The user should upload his/her file geodatabase at runtime in the web interface for that workspace. The problem is that the browser will not let the user select the folder defining the file geodatabase. Furthermore selecting all subfiles of that geodatabase will lead to a failed run. What is it that I am overlooking? Thanks in advance!

503
xanduqe
Contributor
lennardrty
Participant
lennardrtyParticipant
asked in Data
Read specific files in directories via user parameter

Hi all I have an FME Workbench file which has to do the following things: Ask for multiple directories via a published user parameter read two files in each directory which end in _changes.shp and _to_remove.shp AND are always located in a subfolder v1 in each directory. The transformers and writer after that are already doing what they should do, but I can’t seem to confgure my reader to do what I asked here. Is this even possible to do? And if so, how should I do this? Thanks in advance for the help!

481
bwn
Evangelist
diegoromerotech
Observer
diegoromerotechObserver
asked in Data
How to Automatically Open Inspector in a Separate Window After Translation in FME 2024?

Hello, I'm using FME form 2024 and I would like to know how to configure the software so that the Inspector automatically opens in a separate window after a translation is completed. I’m having trouble finding this option in the interface. Could someone please guide me through the steps to achieve this in FME 2024?

451
j.botterill
Influencer
nikpatel
Contributor
nikpatelContributor
asked in Data
FTP CSV File Reader : need to read current date file

I am new bee and want to generate FME flow which reads every day file from SFTP server and populate the data the first half of the file is default then their is date concatenation with “MMDDYYYY” format and then suffix with file extension i use datetimestamper transformer and found the date but when pass that date to FeatureReader in Dataset with “default text”@Value(_Date) , it does not generate the file Can someone help with if their is any example which can provide me guidance on how to set auto filenames

744
nikpatel
Contributor
jugoslaviaa
Enthusiast
jugoslaviaaEnthusiast
asked in Data
Removing Surrounding Parentheses in a Field

I have a field that contains values with parentheses, like (0601310951181134359628), and I would like to remove them. The parentheses always appear once at the beginning and once at the end of the field. I am currently able to achieve this using two StringReplacer transformers, each removing one parenthesis. However, I would like to do it in one step. I tried the recommended regex expressions from previous posts, but none of them worked. Any suggestions?

403
david_r
Evangelist
jatoxa
Contributor
jatoxaContributor
asked in Data
Update AutoCAD block attribute

Hi all, I want to update certain attributes in a DWG block. To the left where it says "test" I have updated an attribute. However FME writes out duplicate blocks and the new one is also bigger than the original. Is there a way to update attributes and write the changes to a DWG without touching anything else? Thanks! /Jacob

782
khizar
Participant
froberts
Contributor
frobertsContributor
asked in Data
Mbtiles conversion create Black tile background

I have tiff file that I have been provided when I run it through FME Workbench 2024.2 to create a mbtiles package, I get this strange black background, I assume it is the defulat tile for the area. The orginal tiff only occupies the extent of what you see in the map itself below. So the conversion is tacking on this huge black boundary. Any ideas on how I make it not do that? I have included a screen shot of my settings below. Thanks for any ideas!!

232
froberts
Contributor
kanteyemaodo
Contributor
kanteyemaodoContributor
posted in Data
EXTRACTION dgn vers shp

j'ai un fichier dgn contenant les câbles de type polyligne avec leurs extrémités. -je veux extraire les câbles et les convertire en shapefile (.shp) avec les noms des extrémités.???

9711
kanteyemaodo
Contributor
fme_hans
Contributor
fme_hansContributor
asked in Data
Allign in PDFPageFormatter

Hi,I am trying to prepare a PDF with the PDFPageFormatter. I have 6 input ports in the PDFPageFormatter and it seems impossible to align them exactly with each other. I have the same upper left x and -y for all 6, the same size. I selected them all and centered them with allign. but there is still one of the input ports that shifts slightly. How can you set this alignment correctly?The top part of the attachment is the Data Inspector. The bottom part is the PDF. The green areas have shifted.

252
fme_hans
Contributor
garyb
Contributor
garybContributor
asked in Data
Shape defined within template is not stored. Error

I saw a very similar question to this from a couple of months ago where the poster managed to resolve it on his own, but his fix did not work in my case. I'm reading from AutoCAD Map OD (multiple files) and writing to AutoCAD Map OD (single file). I've checked my template file and Shape File Folder Path and they all seem to be fine, so I don't understand this error or why my workspace won't run.

545
ferhdfme
Contributor

Helpful Members This Week

Badge Winners

Show all badges

Popular Tags

Community Stats

31,078
Posts
117,817
Replies
38,836
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.