Using readers and writers to extract and load data.
Recently active
Hi there - We'd like to create a workspace document that searches for log files in a series of folders (most are FME logfiles, but not all), then searches through each log file for errors, run length, etc., then update an SDE table with this information, and send some email notification on failures.I've got no problem with adding a data reader to search for and find the log files. However, after that, is there a transformer I can use to search through each file and extract the information? Or do I need to do the search/extract via a python caller?Thanks. M. Knapp
I am transitioning from using ERDAS Imagine to FME to generate ECW filesI need to understand the difference between the terminology used by both systems with regards to compression.FME ECW writer refers to "Compress by Percentage (0-99)" with a default of 75this means that the output image will be 75% compressed, or one-quarter the sizeERDAS Imagine refers to "Target ECW Compression" with a default of 20this means that the output image will be compressed by a ratio of 20:1, or one-twentieth the size.Two questions;1) Why does FME use a compression percentage and not a compression ratio (the convention established by ERDAS)2) Why is FME's default compression different to ERDAS's default compression?
I have a DWG file with simple 3D shapes of buildings for a town, I need to convert it to Geodatabase so I can import to CityEngine. I can inspect it ok. I have tried various ways to convet it but nothing seems to work. In particular, when I attach a gdb writer there is no option to output a surface geometry (see screenshot). I also tried the auto generate workspace but that output an empty file. Any idea what im doing wrong?
My input data is DGN with complex shapes created orginally from lines. I would like to convert the complex shapes to simple shapes
I did some easy tests on reading CityJSON and writing out the same data I just read in.Reading was easy. Problems start when I try to write the data I just read in.I always get some error ffs with Feature types I don't understand and I don't know where they come from: The CityJSON file which is written cannot be read in again as a CityJSON fileCITYJSON reader: An error occurred. FME will attempt to provide more information on the error, but this may cause the translation to be terminatedRead Metadata Feature Command caught exception: stk::ex::FatalError[0] CITYJSON reader: [json.exception.out_of_range.403] key 'boundaries' not found[1] auto __cdecl STFReader::getFeature::<lambda_e8ad0c4de285582507d80bbbf97fb805>::operator ()(void) const(C:\\code\\fme\\foundation\\framework\\engine\\reader.cpp:61) It is a tech preview, OK and I managed to write CityGML successfully.Any guideline how to do this properly for CityJSON ?Michael
Hi,Since I've updated my FME Desktop to the 2020 version the values when my field name is suffixed with a * aren't been read into FME. I know FME changes the * to _ when it is loaded in Desktop, but this wasn't an issue before.For example, below is a screenshot of my Excel file.And this is how FME deals with it.You can see the values in Your Name* doesn't get read.As I say this wasn't an issue in previous versions. Is there something new I should be aware of?RegardsPaul
I'm reading an HTML table from a website and its bringing in both Real64 and Real32 numbers which I'm writing to a Geodatabase table. No matter if I specify column types of Float, Double, or Integer I get unwanted results where the number has a comma separator in the thousandth position (From table) - the resulting number adds a period in the output. Some of the numbers are dropping a zero when the number ends with zero: 8450 becomes 845. Has anyone experienced this before?
Hello,I need to retrieve the value of a column header in a CSV file. The column header contains the ID of a meter I need to use as an insert into a database. Unfortunately I can't use a filepathreader as the id filed isn't included. Any idea how I might do this? I have attached a test file. The value I need to extract from the column header is the string after the undescore.
Hi All,Is it possible to write an AutoCAD Layer to a DWG File with no geometry, so that it acts as a placeholder for the end user before starting the digitization process?Thanks,Ana
Hello everyone! I need your help urgently! Please help me!I have a point cloud data from Faro Laser Scan. Scan is from a archeological site. I want to see how much of the area is in related parcel boundaries. So, I mean want to see our scan area on our parcel lines. Parcel boundary is in dwg. format. And both of them in same coordinat systems.,In which format is most useful for point cloud export from Scene Software for this?
I would like to read a dwg including modelspace and paperspace data, edit the data and write to dwg including the same model and paperspace.Writing to modelspace works, how can I write/copy the data to paperspace?
i would like to extract the whole attributes from pdf adobe Geospatial pdf .what i did exactly and iam not sure if i extracted the data to be as DGN and it seems good with text on it but my question exactly say if the data is geospatial pdf or dgn ,Does it ossible to extract the information that included inside the data . in my data it looks like nodes and lines connected together and lines connected to lines also each lines has labels ,i would like to extarct each labels include inside it and know which labels connected to which labels as shown inside the file . Is it possible to do ,and if yes ,could someone guide me how to do it .by the way when my reader in FME read my data ,it reads it as pdf no layer is it problem bcs i saw some videos include too many layers excet my file ,write pdf_no layer Thanks alot for any help or suggestions.
Hi! I am need to convert LV national data to EPRTR with Safe Software FME Workbanch. I am try to create GML Writer with using published XSD schema on: http://dd.eionet.europa.eu/schemas/EPRTRandLCPintegration/eprtrlcp_v_1.0.xsdThe GML Writer is not setting up! See in log file: Starting translation...FME 2019.2.0.0 (20191105 - Build 19801 - WIN32)FME Desktop Oracle Edition (floating), FME Home Edition (node locked-crc)Temporary License: 154 days left.Machine host name is: GID-ArvidsO7Operating System: Microsoft Windows 7 64-bit Service Pack 1 (Build 7601)Copyright (c) 1994 - 2019, Safe Software Inc.Safe Software Inc.Creating reader for format: NULL (Nothing)Trying to find a DYNAMIC plugin for reader named `NULL'Loaded module 'NULL' from file 'C:\\apps\\FME\\2019\\plugins/NULL.dll'FME API version of module 'NULL' matches current internal version (3.8 20190820)Opened mapping File C:\\Users\\arvidso\\AppData\\Local\\Temp\\FME_1583926567576_11844.fmw for outputMa
Do we have a method to color the sum of count .I did a sum and I converted my output to csv file then I read it again but I want to color the background of the sum of count result at column BBut I do not know how to do it ,I tried @value(count)But it does not work Bcs the file written in csv and read it again by feature reader. At the end write to excel file Fme version 2018Could some one help me and thanks
Is there a way in a workbench to retrieve a list of all the valid formats that the version of FME currently running the workbench can use? A separate static file isn't really able to solve my issue. I know it is a strange request.Essentially, we are using FME Server and will be using a Generic Reader to parse all user provided data then filter by a pre-configured list of valid formats my workbench will read from. The clients require the ability to add new formats and I'm trying to see if we can create a workbench that validates their configuration file against what FME can actually do.
I'm getting a ton of issues with 'Duplicate Consecutive points' when trying to write SHP to ArcSDE and the GeometryValidator is no helping in remedying these. About 25% of my polylines are being rejected. The Shapefiles come out of a commercial subsurface modeling software, so I have no control over how they are written.Is there a way to ignore the duplicate point? ESRI software isn't complaining about this issue with the data. But I sure prefer doing my work in FME.
FolksI'm going slightly mad trying to get a transformation from shapefile to INSPIRE GML to run successfully. I've succeeded with about a dozen, but one particular file just refuses to play ball. When I first tried it, it crashed midway through, so I've spent a large amount of time trying to make sure the input data is free of errors. I imported it into PostGIS and ran validity checks, then ran it through the QGIS topology and geometry checkers (and corrected everything they threw up using some of the GRASS tools available, and manual editing where they couldn't correct the problem automatically), then connected the shapefile to a GeometryValidator transformer and it says there aren't any issues. But... when I try and run the whole process, it just hangs up. The sticking point seems to be the SurfaceBuilder transformer; when I connect an inspector to it I'm getting the following warnings:Dissolving a donut produced more than one outer shell. Picking a representa
So I need to admit I am absolutely lost in an attempt to use a connection for an existing ArcGIS Portal Feature Service.I have spent hours to find my way to create a connection for the parameters I need in order to access an existing ArcGIS Portal Feature Service and I fail miserably. I get lost in dialogs where I feel like I need to learn Web development instead of just saving the infos I need in order to use it later on.The Information I have and I need to access the existing portal Feature Service is:UrlFeature Servicemethoduserpassword... and instead of allowing me to save a connection with these parameters I am sent on a journey through Feature service templates where I don't have the slightest idea what I need to input.This kind of frustrating adventure is absolutely normal for too many tools out there, but I am not used to this from my long time FME experience.Where have I lost my way ? And please don't come up with details like REST call so and so ;-( HeeelpMichael
I tried converting a shapefile to cesium 3dtiles but after conversion some wall surfaces of the shapefile buildings are missing.When i inspected the data in fme data inspector the missing wall surfaces are transparent.Why some surfaces are transparent, I have attached the image of the shapefile viewed in inspector .How to bring all the wall surfaces in the output tileset without missing.
I've been looking at all the various options people have for Dynamic Schema changes in a CSV reader. But the only thing that consistently functions seems to be the "Update Reader" Menu option.Scenario: I have a single CSV where the schema gets added to on a regular basisWeek 1: 'col1, col2, col3, 'week 1'Week 2: 'col1, col2, col3, 'week 1', 'week 2'Week 3: 'col1, col2, col3, 'week 1', 'week 2', 'week 3' etc.I need to be able to read in the CSV and output to a DBMS table, pulling in the new column each week.
Feature Writer : ESRI Geo Database(file Geodatabase)Even though I have selected GEODB_POINT as Geometry in feature writer parameters.Tried to convert in to point using vertex creator but no luck.Can anyone help me how to write point feature class instead of multipoint.
Excel Writer: Column name 'A.formatting' for sheet 'cars' could not be used as a column position.Error shows to me bcs i used Excelstyler before feature writer but iam using the option use attribute names as column position Yes and i need it . i know also it should A.formatting inside the user attribute but it occurs to terminate the program .so any suggestion ,how could i change back ground color of some cells in the first column without terminate the programThanks
I had this problem beginning in FME 2018 32-bit and thought it was related to the JVM memory issue, but I upgraded to 2019.2 and I'm still having a problem connecting to oracle databases intermittently. Here's one case: I have an sde reader (non-legacy) that is set up using a path to an sde connection file. I go to import a second feature type to the same reader and I get an error:Unable to connect to Oracle database, because the database environment could not be initialized.If I manually type the featureclass that I want to add into the dialogue, it actually just loads up, but I can't browse the Table List to pick it. Another case is in the oracle non-spatial connection that I'm using with a sqlexecutor or sqlcreator. Sometimes I can create and test a sql string just fine; other times I get the same error:Unable to connect to Oracle database, because the database environment could not be initialized.If I completely close FME and reopen, sometimes it works again. Som
Hello, I have Roof, Wall, Floor, Building Part, Window and Door in FBX format. Once it is converted into citygml format the output i get is as follows The building layer contains the complete data set and the other layers contain the respective data sets as mentioned in the layer name. But if i turn off the building layer the data is not hidden as the other layers are independent and contain the different items. Attached below is the screenshot of my workbench. However I am looking for a different kind of output. The building should act as the main layer and other features should come in as sub layers for the main layer. Similar to the attachment below. This would let me turn off the building layer as a whole or I can turn off the different sub layer as per need. Please let me know if someone can help me to resolve this. Thanks in advance to everyone. Regards,
Hi! i have to read dwg plans and export information from the title block to excel. Just few values are interesting to me. I have an excel sheet with possible attribute values so only values which are both in the Autocad and in the "reference excel sheet" go to the final writer in excel format.for example:Cad provides the attribute autocad_text_stringautocad_text_stringgreenThursdaywhite380012/01/2019FebruaryNAMEPeterExcel reference sheetColoursDays of the weekMonthsNamesblueMondayJanuaryLaurayellowTuesdayFebruaryMaryredWednesdayMarchAnnegreenThursdayAprilJuliaorangeFridayMayCharlesblackSaturdayJunePeter SundayJulyAnthony AugustBob September October November December The writer should look like this:ColoursDays of the weekMonthsNamesGreenThursdayFebruaryPeterSo the final table contains values that were in both places. The rest are not relevant. Does this make any sense? Hope to get help because I don´t know how to make the connection between my 2 readers in an effecti