Using readers and writers to extract and load data.
Recently active
Folks, I'm having trouble getting an actual object out of my Mapinfo objects and getting them represented in GML. Being that FME is (Feature Manipulation Engine) I expected this was implicit but it appears not. The Mapinfo Reader doesn't present an "object" to perform some kind of process on. I'm taking a guess I need some kind of Transformer. I tried a GeometryExtractor. I presume the Input is implicit in that I attached it to the Mapinfo table. I have some options on the output. I selected GML v3.1.1.(matches my schema) and named the output to match the GML tag I'm targeting. Running the conversion shows no errors but neither does it give me a "poslist". I did see a GMLFeatueComposer with enough sophistication to reference my XSD but this threw and error when the translation was run.BTW my attribute tagging works perfectly in the translation so at that minimal level I have a GML (that has no Geography)Any guidance appreciated.
Hi All,I develop a workspace to transfer the mdf to gdb but the feature class in file geodatabase have the same name of the feature in mdf.For example I have mdf “B” containing five feature class when I transform them into file gdb as you can see belowIs there any way to change the name of feature class from “dbo_COMMUNITIES_point” to “communities” by adding a transformer to my workspace? Best Regards,Rawan
I've got some CSV Writers from FME 2016.1 and I obviously want to take advantage of the new CSV2 Writer. I thought I could make life easy by editing the Feature Type properties and changing the Writer from CSV to CSV2 but FME ended up crashing. So I presume creating things from scratch with the new Writer is recommended way...?
Hi,I am new to FME. I currently have 286 old gdb that consist of 15 feature classes, they needs to be updated to a new gdb. Some of the updates includes: changing a point to polygon, merging feature classes, changing fields name, and also mapping value for subtype. I have already figure out how to update an individual gdb.Right now, I am playing around with Workspace runner and Directory and File pathnames reader. I am uncertain about some of the parameters. In my workspace, for my reader and writer, does it matter if I load any old gdb as the reader? and any new gdb as the writer? I have attached below what my current workspace looks like.Can you please help me out? It would be very much appreciated :-)Thanks,Vincent
Since every country in the world except The USA, The Gambia and Myanmar is now using metric units could we have a set of default templates in FME in metric units? Or at least an option to switch back to Imperial?Does anyone in a metric country have a set of default.dwg, (and 2007, 2010, 2013 versions) for FME that they could share?
I am using Smallworld 4.22 translating to Microstation V8i with FME version 2014sp4 The font in Smallworld is an old font Hershey-Roman-Narrow. I am adding a Character 127 which is the Degree symbol (0176 in Arial) . I have in the past been able to use the StringReplacer to replace a special character but this time it is not working. I am guessing that I am just doing it incorrectly. When I print out the line string in my Smallworld buffer is prints out as <delete> if I add a write statement in the code as it is generating the text if writes ^?. In the code I am adding the degree symbol as 127.as_charater() When I run the translation with or without the string replacer in the data inspector shows it as what appears to be a PIPE ( | ) character. In Microstation it shows as a Diamond with a question mark in it.I guess what I am needing is any help with StringReplacer and special characters.
I have a KML writer with dynamic attribute definition. The writer always writes a KMZ file but I want it to write a KML file. When you use a static writer you can specify the filename and extension in the writer as either ".kml" or ".kmz" but when it is dynamic you just give the path to the folder and "fme_feature_type" as the feature type name. Also there is no suffix on which to fan out.How can I get the writer to write KML?Thanks
Hi Everyone !For the purpose of my mission during my internship, i must convert a DWG file to a KML file.My boss told me using FME was the best choice. I didn't know FME before, I just begin using FME to solve this problem.I tried to convert the file with FME Quick Translatetor (following the FME Tutorial) using "Autodesk AutoCAD RealDWG DWG/DXF" for the DWG file in input and "Google KML" for the KML file in output.It failed and return this error :KML: Feature does not have a coordinate system specified+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Feature Type: `0'Attribute(16 bit unsigned integer): `autocad_color' has value `7'Attribute(64 bit real) : `autocad_elevation' has value `0'Attribute(encoded: utf-16) : `autocad_linetype' has value `ByLayer'Attribute(string) : `autocad_linetype_scale' has value `1'Attribute(string) : `autocad_lineweight' has value `-1'Attribute(64 bit real) : `aut
I have setup a test filter that separates out a number of shapefiles based on part of the filename. I now want to use the output port that these features will run through as the new table name. Is there an easy way to do this, or do I need to create a writer for each port so that this has the correct table name.
Hi,I got a workbench published to FME server as an Jobsubmitter service now i want to call or execute this work space from an oracle trigger which triggers after an update to that table.Below is my function would be called from the oracle table trigger but i can't see the workspace execution has started or completed.I got proper UTL_HTTP access to the user and no errors while executing the function.Can anyone shed some light what is the proper way to achieve this?**********************************************************************************************************CREATE OR REPLACE FUNCTION DBUSER.FME_CALL RETURN BOOLEAN AS message varchar2(20); req utl_http.req; BEGIN message := '99999'; -- Call the workspace req := utl_http.begin_request('http://FMEServer/fmejobsubmitter/training/xml2dwg.fmw','POST'); utl_http.set_header(req, 'User-Agent', 'Mozilla/4.0');utl_http.set_header(req,'Content-Type','TEXT/HTML&#
I'm new to FME so would like some help understanding what is happening in the backend. I am running FME 2017 Desktop.I have the below workspace which is extracting the min and max band figures of an ECW and logging whether all of the bands have a min of 0. At present I am testing with only 3 ECW files.I have been watching the process run, and I saw the the RasterBandMinMaxExtractor took around half an hour which I expected. However, once the first feature reached the appropriate logger, there was then nearly a 45 minutes wait before the next feature was run through the process.This is what appears in the Translation Log following the final Logger line.2017-04-26 14:23:04|2301.7| 0.0|INFORM|================================================2017-04-26 15:07:26|3096.3|794.6|INFORM|Creating reader for format: ER Mapper ECWI checked the temp directory and there were no temp files being created during the time. So I'm a bit stumped on what's going on.TIA
Hi i am new to FME,we are trying to set up 2 tier architecture.Is that mandatory to have the file system installed on a separate server (please refer the attached image for the instruction i found online) or it can be on the same web/Application server itself? I assume that this file server is a shared directory and can be anywhere on the network.Thanks,Mari...
I'm exploring the new Geopackage tiles writer in FME2017. I would like to to create a GeoPackage with the "Use incoming feature" tiling option. In this case the projection should be UTM35. This works fine, but the option to generate additional zoom levels is disabled. This means that I have to use gdaladdo.exe on the GeoPackage file afterwards to generate additional zoom levels (overviews). Is there any way to create a GeoPackage with custom tiling and additional zoom levels?
Is it possible to manipulate text to conform to a standard if each line varies slightly?As you can see in the converted format I deleted the first 6-8 characters at the beginning of each line, removed some spaces and replaced with semi-collins some with commas, and added some ID at the end.This is currently done manually with a beefed up Notepad but I would like to feed the txt into a transformer to complete this.existing format 4 SDWP SAXEL FB N 47 58 46.1498 W 066 15 38.3245 5 FAWP TAVLU FB N 47 58 20.4669 W 066 13 02.6285 6 IWP GONEX FB N 47 56 54.2098 W 066 04 22.6074 7 IAWPL MATAX FB N 47 51 26.2613 W 066 03 30.7522 converted format SAXEL,N47:58:46.1498,W066:15:38.3245,16-05361 TAVLU,N47:58:20.4669,W066:13:02.6285,16-05361 GONEX,N47:56:54.2098,W066:04:22.6074,16-05361 MATAX,N47:51:26.2613,W066:03:30.7522,16-05361
FME 2017.0 reading CSV data including dates in the format 2009-04-23 with no quotes around them.I'd like to write this straight to an SQL Server 2012 table so I've connected the Reader straight to the Writer. However it won't write the date values from the CSV into the SQL Server table as a date field.So I thought I'd take advantage of the new DateTime functions to save having to stick a DateFormatter in the middle. So I've been trying things like @DateTimeFormat(@Value(col4),%Y%m%d) and @DateTimeFormat(@Value(col4),%Y"-"%m"-"%d) in the Value column under User Attributes in the Writer properties. But I can't seem to find anything that works. I've tried @DateTimeParse, @DateTimeCast, @DateTimeFormat but the Translation Log keeps throwing up warnings e.g. 'Failed to evaluate expression '@DateTimeParse(2008-02-29,%Y%m%d,repair)'. Result is set to null.'Is this actually possible or do I need to go back to using the DateFo
I need to convert 1 Channel, 1 Palette GEOTIFFs to GEOTIFFS with only 1bit (true b/w). So far I managed to split an incoming GEOTIFF-feature into several new GEOTIFF-features (one new feature for each used color in the palette). Afterwords I change them to black and white by using the expression evaluator. Despite the fact that only two colors are used it is technically a 3 channel 8-bit/channel Geotiff right now. By using a RasterSelector and the RasterPaletteGenerator I convert this to a 1 channel 1 Palette Geotiff, where the palette only has two used entries.However I found no way to save it as a true (1bit) bitmap with the GEOTIFF-Writer.Any ideas out there?Uwe
Hi, I have numerous DGN files and I want to set up a workflow that checks whether they are 2D or 3D files. I know I can use the DimensionExtractor to check individual features but I want to do a check on the actual file type itself. Is there an IGDS attribute I can expose to do this?I have both FME Desktop 2016 and FME Desktop 2017.Thanks
I'm using five Excel readers that are pulling the spreadsheet data from a REST endpoint (URL). The purpose of the model is to combine all five spreadsheets into one output. They have the same schema. The issue I'm running into, is that the spreadsheets will all have a variable number of rows from week-to-week and when I specify the Cell Range in the Reader Parameters as (*:) the writer is still including all of the blank rows below the data for each spreadsheet, so the final output has a chunk of data, blank space, chunk of data, blank space, etc. Is there any way around this?
Hi,I just encountered an unexpected problem with the MSSQL_SPATIAL writer.I originally set a manual command ("exec some-stored-procedure-with-arguments") to define a spatial index and more, which err'ed because there was no primary index on the relevant table. That's fine and understandable.As I really didn't needed a spatial index on the specific table anyway, I just switched the dropdown "Spatial Index Type" to "None", and reran the translation.But the translation still failed in the same place, while trying to execute the now deselected and unwanted command.It seems like the command was still present, and FME tried to execute it as such, even though the setup stated it shouldn't. This I believe to be buggy behaviour, the overall choice should not be overridden like that.Cheers Lars I.
The best practice to print 20,000 rows of 6-columns each in pdf landscape A3 page size while to repeat the 6-columns 3 times in each page ,I couldn’t figure out how to print 20,000 rows of 6-columns each in pdf landscape A3 page size such that the 6-columns can be repeated 3 times in each A3 page as shown in the screenshots below
Dear FME-Users, I’d like to create JSON-files which describes some metadata of NetCDF input data. It works well when I use the “RasterToPolygonCoercer” before, but this transformer takes a lot of time. Without conversion to vector data the JSON-file doesn’t describe the metadata of every single pixel, even by using “RasterCellCoecer”. Please take a look in the attachment, there are 2 screenshots of 2 JSON-files. Necessary is that every cell value of the input data is listed in the JSON-file. Maybe it works with the “JSONTemplater”, but I don’t have any experience with this transformer. If you have some ideas, it makes me happy. :) Thank you very much and best regards. Konrad
Hi, I'm trying to create an error file with AutoCAD DWG/DXF Reader/Writer and i've got an issue : Specified block 'CENTRO_LOCAL' is not defined in AutoCAD file. Skipping featureMULTI_WRITER: multi_writer_id `3': Writing feature 0 AutoCAD Writer: Performing database audit...AutoCAD Writer: An error occurred for dataset 'D:\\Routines2014\\LOGS\\DWG_ENGLOS_01122016.dwg', in function AutoCAD2004Writer::setExtents. Exception thrown: 'Invalid input'A fatal error has occurred. Check the logfile above for details... Last line repeated 2 times ... Anybody's got an idea ?
Is it possible to add extra z-value to a point cloud (las) with 3D affiner? I need to add extra 0,507m to my already existing z-values. I'm changing from a local to an national height system but i don't know the parameters from the local one.regards, Anton
Dear FME-users, I’ve created a GeoTIFF-file based on NetCDF-data. The problem is the spatial reference. A compare to OSM-data in the attachment shows you, that the GeoTIFF-file is not placed right. The second picture is from Copernicus and right placed. Do you have an idea? Thank your very much. Best regards. Konrad
Is this possible? Or do I have to recursively use FTPCaller for "each level" of the ftp/sftp and build the strings manually? This is on both FME Desktop and FME Server. Even better: Add support on FME Server to "Add resource" and Type of Resource Connection would be ftp/sftp