Using readers and writers to extract and load data.
Recently active
Hello!I am new FME user and I trying to transform multiple dgn files fronm ED50 to ETRS89. I use Quick Translator to do it, and there is no problem if I tried with only one file. But if I tried to do it with multiple files at the same time the levels numbers are changed.If in origin, the information levels are 51 and 52, in the destination files are 14 and 15, for example.How can I keep the source information? Thanks Afp
Hello,I am processing data and write the results to Textfiles , using a fanout and the featurewriter.Now i want to add some headerlines (read and blue) in front of the exported lines (black). Plase, refer to the screenshot.The red lines are the same for any of the files. Only the blue line consistes of a constant part (file.) andthe filename which is individuel. The number of resulting Textfiles varies.Any ideas are highly appreciated!
Hi.I want to compare two 3D-models (Buildings) to see differences, visually and statistically.Any idea how to do it?The buildings is in .dwg at the moment but i guess i can transform them to any 3d format first if another format would be better for this project.The background is that i made 3D-buildings from lidar-data and want to compare the resualt of the model output to reference data (terrester lod2 buildings in .dwg).regards,Anton
Hello FME users, I'm a beginner in HTML code and need some help extracting tables from websites. I've been using the HTMLTable Reader and it has been great if I need to work with just one hyperlink. I'm currently trying to use the HTTPCaller to extract tables from 300+ attributes that have hyperlinks attached. I'm trying to only extract the 'WELL HISTORY' tables for each attribute.An example hyperlink is below:http://sonlite.dnr.state.la.us/sundown/cart_prod/cart_con_wellinfo2?p_WSN=199138Copy of HTML code is attachedAny and all help is greatly appreciated.Thanks
I've looked at a couple of similarly named questions and they're not quite what I'm after.I have a work space with many Mapinfo Tables being written to many GML feature types into a single output GML file. I'm getting varying orders of output. For example I have a GML Feature called "Header". I'd like that written first. Is there a way to prioritise the execution?In addition I have two GML Features that use the same MI table as a source. Oddly or perhaps obviously, the output order is "woven" together.egGML Feature 1GML Feature 1GML Feature 1GML Feature 2GML Feature 1GML Feature 1GML Feature 2GML Feature 1GML Feature 2While I know write order is inconsequential in XML\GML there is a process where somebody eyeballs the Header in a text editor to make sure the content is correct. Looking for the header buried in the files just adds time.Any advice appreciated.
Does someone have input on why I can't run my workspace due to this error message? Thank you
i have CSV file with given shape_area and shape_length. How can I convert it into closed polygon? thank you.
Folks, I'm having trouble getting an actual object out of my Mapinfo objects and getting them represented in GML. Being that FME is (Feature Manipulation Engine) I expected this was implicit but it appears not. The Mapinfo Reader doesn't present an "object" to perform some kind of process on. I'm taking a guess I need some kind of Transformer. I tried a GeometryExtractor. I presume the Input is implicit in that I attached it to the Mapinfo table. I have some options on the output. I selected GML v3.1.1.(matches my schema) and named the output to match the GML tag I'm targeting. Running the conversion shows no errors but neither does it give me a "poslist". I did see a GMLFeatueComposer with enough sophistication to reference my XSD but this threw and error when the translation was run.BTW my attribute tagging works perfectly in the translation so at that minimal level I have a GML (that has no Geography)Any guidance appreciated.
Hi All,I develop a workspace to transfer the mdf to gdb but the feature class in file geodatabase have the same name of the feature in mdf.For example I have mdf “B” containing five feature class when I transform them into file gdb as you can see belowIs there any way to change the name of feature class from “dbo_COMMUNITIES_point” to “communities” by adding a transformer to my workspace? Best Regards,Rawan
I've got some CSV Writers from FME 2016.1 and I obviously want to take advantage of the new CSV2 Writer. I thought I could make life easy by editing the Feature Type properties and changing the Writer from CSV to CSV2 but FME ended up crashing. So I presume creating things from scratch with the new Writer is recommended way...?
Hi,I am new to FME. I currently have 286 old gdb that consist of 15 feature classes, they needs to be updated to a new gdb. Some of the updates includes: changing a point to polygon, merging feature classes, changing fields name, and also mapping value for subtype. I have already figure out how to update an individual gdb.Right now, I am playing around with Workspace runner and Directory and File pathnames reader. I am uncertain about some of the parameters. In my workspace, for my reader and writer, does it matter if I load any old gdb as the reader? and any new gdb as the writer? I have attached below what my current workspace looks like.Can you please help me out? It would be very much appreciated :-)Thanks,Vincent
Since every country in the world except The USA, The Gambia and Myanmar is now using metric units could we have a set of default templates in FME in metric units? Or at least an option to switch back to Imperial?Does anyone in a metric country have a set of default.dwg, (and 2007, 2010, 2013 versions) for FME that they could share?
I am using Smallworld 4.22 translating to Microstation V8i with FME version 2014sp4 The font in Smallworld is an old font Hershey-Roman-Narrow. I am adding a Character 127 which is the Degree symbol (0176 in Arial) . I have in the past been able to use the StringReplacer to replace a special character but this time it is not working. I am guessing that I am just doing it incorrectly. When I print out the line string in my Smallworld buffer is prints out as <delete> if I add a write statement in the code as it is generating the text if writes ^?. In the code I am adding the degree symbol as 127.as_charater() When I run the translation with or without the string replacer in the data inspector shows it as what appears to be a PIPE ( | ) character. In Microstation it shows as a Diamond with a question mark in it.I guess what I am needing is any help with StringReplacer and special characters.
I have a KML writer with dynamic attribute definition. The writer always writes a KMZ file but I want it to write a KML file. When you use a static writer you can specify the filename and extension in the writer as either ".kml" or ".kmz" but when it is dynamic you just give the path to the folder and "fme_feature_type" as the feature type name. Also there is no suffix on which to fan out.How can I get the writer to write KML?Thanks
Hi Everyone !For the purpose of my mission during my internship, i must convert a DWG file to a KML file.My boss told me using FME was the best choice. I didn't know FME before, I just begin using FME to solve this problem.I tried to convert the file with FME Quick Translatetor (following the FME Tutorial) using "Autodesk AutoCAD RealDWG DWG/DXF" for the DWG file in input and "Google KML" for the KML file in output.It failed and return this error :KML: Feature does not have a coordinate system specified+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Feature Type: `0'Attribute(16 bit unsigned integer): `autocad_color' has value `7'Attribute(64 bit real) : `autocad_elevation' has value `0'Attribute(encoded: utf-16) : `autocad_linetype' has value `ByLayer'Attribute(string) : `autocad_linetype_scale' has value `1'Attribute(string) : `autocad_lineweight' has value `-1'Attribute(64 bit real) : `aut
I have setup a test filter that separates out a number of shapefiles based on part of the filename. I now want to use the output port that these features will run through as the new table name. Is there an easy way to do this, or do I need to create a writer for each port so that this has the correct table name.
Hi,I got a workbench published to FME server as an Jobsubmitter service now i want to call or execute this work space from an oracle trigger which triggers after an update to that table.Below is my function would be called from the oracle table trigger but i can't see the workspace execution has started or completed.I got proper UTL_HTTP access to the user and no errors while executing the function.Can anyone shed some light what is the proper way to achieve this?**********************************************************************************************************CREATE OR REPLACE FUNCTION DBUSER.FME_CALL RETURN BOOLEAN AS message varchar2(20); req utl_http.req; BEGIN message := '99999'; -- Call the workspace req := utl_http.begin_request('http://FMEServer/fmejobsubmitter/training/xml2dwg.fmw','POST'); utl_http.set_header(req, 'User-Agent', 'Mozilla/4.0');utl_http.set_header(req,'Content-Type','TEXT/HTML&#
I'm new to FME so would like some help understanding what is happening in the backend. I am running FME 2017 Desktop.I have the below workspace which is extracting the min and max band figures of an ECW and logging whether all of the bands have a min of 0. At present I am testing with only 3 ECW files.I have been watching the process run, and I saw the the RasterBandMinMaxExtractor took around half an hour which I expected. However, once the first feature reached the appropriate logger, there was then nearly a 45 minutes wait before the next feature was run through the process.This is what appears in the Translation Log following the final Logger line.2017-04-26 14:23:04|2301.7| 0.0|INFORM|================================================2017-04-26 15:07:26|3096.3|794.6|INFORM|Creating reader for format: ER Mapper ECWI checked the temp directory and there were no temp files being created during the time. So I'm a bit stumped on what's going on.TIA
Hi i am new to FME,we are trying to set up 2 tier architecture.Is that mandatory to have the file system installed on a separate server (please refer the attached image for the instruction i found online) or it can be on the same web/Application server itself? I assume that this file server is a shared directory and can be anywhere on the network.Thanks,Mari...
I'm exploring the new Geopackage tiles writer in FME2017. I would like to to create a GeoPackage with the "Use incoming feature" tiling option. In this case the projection should be UTM35. This works fine, but the option to generate additional zoom levels is disabled. This means that I have to use gdaladdo.exe on the GeoPackage file afterwards to generate additional zoom levels (overviews). Is there any way to create a GeoPackage with custom tiling and additional zoom levels?
Is it possible to manipulate text to conform to a standard if each line varies slightly?As you can see in the converted format I deleted the first 6-8 characters at the beginning of each line, removed some spaces and replaced with semi-collins some with commas, and added some ID at the end.This is currently done manually with a beefed up Notepad but I would like to feed the txt into a transformer to complete this.existing format 4 SDWP SAXEL FB N 47 58 46.1498 W 066 15 38.3245 5 FAWP TAVLU FB N 47 58 20.4669 W 066 13 02.6285 6 IWP GONEX FB N 47 56 54.2098 W 066 04 22.6074 7 IAWPL MATAX FB N 47 51 26.2613 W 066 03 30.7522 converted format SAXEL,N47:58:46.1498,W066:15:38.3245,16-05361 TAVLU,N47:58:20.4669,W066:13:02.6285,16-05361 GONEX,N47:56:54.2098,W066:04:22.6074,16-05361 MATAX,N47:51:26.2613,W066:03:30.7522,16-05361
FME 2017.0 reading CSV data including dates in the format 2009-04-23 with no quotes around them.I'd like to write this straight to an SQL Server 2012 table so I've connected the Reader straight to the Writer. However it won't write the date values from the CSV into the SQL Server table as a date field.So I thought I'd take advantage of the new DateTime functions to save having to stick a DateFormatter in the middle. So I've been trying things like @DateTimeFormat(@Value(col4),%Y%m%d) and @DateTimeFormat(@Value(col4),%Y"-"%m"-"%d) in the Value column under User Attributes in the Writer properties. But I can't seem to find anything that works. I've tried @DateTimeParse, @DateTimeCast, @DateTimeFormat but the Translation Log keeps throwing up warnings e.g. 'Failed to evaluate expression '@DateTimeParse(2008-02-29,%Y%m%d,repair)'. Result is set to null.'Is this actually possible or do I need to go back to using the DateFo
I need to convert 1 Channel, 1 Palette GEOTIFFs to GEOTIFFS with only 1bit (true b/w). So far I managed to split an incoming GEOTIFF-feature into several new GEOTIFF-features (one new feature for each used color in the palette). Afterwords I change them to black and white by using the expression evaluator. Despite the fact that only two colors are used it is technically a 3 channel 8-bit/channel Geotiff right now. By using a RasterSelector and the RasterPaletteGenerator I convert this to a 1 channel 1 Palette Geotiff, where the palette only has two used entries.However I found no way to save it as a true (1bit) bitmap with the GEOTIFF-Writer.Any ideas out there?Uwe
Hi, I have numerous DGN files and I want to set up a workflow that checks whether they are 2D or 3D files. I know I can use the DimensionExtractor to check individual features but I want to do a check on the actual file type itself. Is there an IGDS attribute I can expose to do this?I have both FME Desktop 2016 and FME Desktop 2017.Thanks
I'm using five Excel readers that are pulling the spreadsheet data from a REST endpoint (URL). The purpose of the model is to combine all five spreadsheets into one output. They have the same schema. The issue I'm running into, is that the spreadsheets will all have a variable number of rows from week-to-week and when I specify the Cell Range in the Reader Parameters as (*:) the writer is still including all of the blank rows below the data for each spreadsheet, so the final output has a chunk of data, blank space, chunk of data, blank space, etc. Is there any way around this?