- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,826 Posts
25,149 Replies

When you subscribe we will email you when there is a new topic in this category

6826 Posts

Most replies

Most views

Newest first

arnold_bijlsmaEnthusiast

asked in Data

Can I use multi lines in Open Text Editor?

I am trying to get the last 6 or 7 characters from an attribute called [event_name], and am using the built-in Open Text Editor on the AttributeManager transformer to extract this substring. But it comes out like this:@ReplaceString(@Substring(@Value(event_name),@FindRegEx(@Value(event_name),M[1-9]),@StringLength(@Value(event_name))-@FindRegEx(@Value(event_name),M[1-9])),-,_)which I think looks horrible and is difficult to understand. Is there a way I could break this down into multiple lines with local variables, like you do in a Python startup script?

Hello, Feature Type RunwayTimeSlice (Runway Class (http://webprisme.cfmu.eurocontrol.int/aixmwiki_public/bin/view/AIXM/Class_Runway" target="_blank">https://extranet.eurocontrol.int/http://webprisme.cfmu.eurocontrol.int/aixmwiki_public/bin/view/AIXM/Class_Runway)) has an Attribute annotation{}. But it doesn't find its way into my XML File. ;) I tried it the same way as shown in the AIXM Demo for responsibleOrganisation (EU Airports Demo (https://knowledge.safe.com/articles/How_To/AIXM)), but it doesn't work. What am I doing wrong? Shouldn't this one produce something like this?: <aixm:annotation> <aixm:Note gml:id="uuid.f19ffb15-d86b-4336-a8e2-04f3af652350"> <aixm:purpose>REMARK</aixm:purpose> </aixm:Note> </aixm:annotation> Help is appreciated :) Melanie

Transform data from raster to vector and working with attribute-data

Dear FME-Users, I’d like to transform data from raster to vector (e.g. shapefile) and add attributes. The transformer “RasterToPolygonCoercer” works, but the second one “AttributeCreator” doesn’t add the desired attribute. I’ve already verified the output-shapefile in ArcMap. The second step includes to read and classify attribute-data from raster, classify them by breakpoint and add them to the new attribute. Maybe someone of the community here have ideas and can help me. Thank you so much. :) Best regards!

How to convert MapInfo .TAB files into DWG file?

I want you to show how to convert a Mapinfo workspace into a AutoCAD DWG file, step by step process.

Merging two MapInfo files using Dynamic Workflow

Hi,I've trawled the knowledge center and have not found a topic or question which covers this, so hopefully I'm not repeating a previous post..I'm trying to merge two MapInfo TAB files (each with the same structure), but coming from different 'Directory and File Pathnames' readers. Let's call the files A and B. File A is the master layer and file B contains features that I want to insert into File A. If these files were read in as MapInfo TAB readers, it would be simple to append the two together. However, as the writer has to be dynamic and the readers are Directory and File Pathnames I cannot do this easily.I have got to a point where the features from File B are being inserted into File A (and writing out in the correct structure) - using FeatureReaders and FeatureMergers. However, the attributes aren't coming through from File B,only the geometry is apparent in the resulting file that is written. There are no attributes present except for the ones coming

Hello, I am new to FME, recently started to work on FME Desktop 2014. I am looking to convert any format to CSV. My requirement is to deposite output CSV to same input folder. e.g. If user selects c:\\temp\\test.shp then test.csv should be written to c:\\temp\\folder. Currently I am able to convert the file but I am not able to set output path same as input path. I am not sure how to achieve this.Any pointers in the right direction will be appreciated. Regards, john

860

8 years ago

gboquinContributor

asked in Data

Reprojecting CAD from NJNAD83 to LL84 text problem

Hi, I am performing a CAD reprojection in FME and it has messed up my the text layers. I am reading and writing the data dynamically. Any ideas of what might cause the text size to blow up? Any parameters to tweak?Thank so much for the help

140

8 years ago

davideagleContributor

asked in Data

Text line aggregation

Hi All,I have a text file with a variable quantity of lines, separated by an empty line. The lines adjacent to one another need to be grouped together and then concatenated. So for example:Test1Test2Test3---testy1testy2---test---(where the hyphens are the blank lines, I can't format this page with return lines it seems)Would need to become:Test1 Test2 Test3testy1 testy2testI've tried to do this a couple of ways so far, and variables seemed to be the right choice initially but now I'm not so sure. As I also have a format attribute on each line that contains the text_line_length, I was trying to use this as the delimiter when it was = to 0. It's interesting because the logic is a bit like using the PointConnector to create line geometries and what I need is to use the text_line_length as the 'connection break attribute'. Anyway, that's a digression. Does anyone have any simple tricks I could deploy to do this?Thanks, Dave

Oracle Spatial - Failed to retrieve feature types

Hi,I am trying to connect to our Oracle 11g Spatial Data using FME however the Oracle Spatial Object reader returns the following when trying to retrieve a list of tables:"Failed to retrieve feature types"I know there are spatial tables present as I can view the data in Arcmap, the log file simply states:"universalreader -- readschema resulted in 0 schema features being returned."Strangely if I read in a shapefile and output this as an Oracle Spatial Table to the same database this then shows and returns the correct spatial data, however I then receive the error below trying to use this in Arcmap:"Error opening feature classLayer not foundLayer not found"This is my first post so apologies if I have missed off any crucial information, thanks in advance for any help on this.Thanks,Charlie

Getting numbers out of cells with text and producing a list with all these numbers

I have a column given to me in a spreadsheet which looks like that:What I need is to get all the references out, the ones in square brackets, to provide with the full list to a user:An then get a full list of all references, as follows:Does anyone have an idea of how I can do this using FME?

The ESRIJSON writer apparently does not write 3D coordinates in FME 2016

If this is the case, then writing 3D coordinates would be very interesting in future releases given the 3D developments in the ESRI JS API 4.x.

8 years ago

femoContributor

asked in Data

How to open a pdf document from a kml feature

Hi,i have some pdf docs residing in Folders. From GoogleEarth I would like to open them by clicking on a hyperlink. Some years back I managed to do that, unfortunately I do not remenber very well how.What I remember is to use the a-tag and the href attribute.So far I did the following:As a result I see the "Link to pdf" appearing as a blue underlined hyperlink. But opening the document fails.I also tried to prefix the "D:xxx" with file://D:xx but it also did not work. The resulting kml file and the pdf folfer with the documents do not reside in the same folder.Any ideas?

Provide dataset path to reader through a Python script

Hi,I want to trigger a workspace using a python script and with that, also want to set the reader dynamically as a parameter. I did look at a few posts previously on this subject like using the workspace runner or the Creator but wasn't sure if that would match my requirement.My requirement is that - I have a set of workbenches that already have a Reader transformer added but I want to override those readers through Python script and provide dataset paths through python script.It would be great help if I am advised whether I am trying this the wrong way and if I should be getting rid of the Readers from all my fmw files and take some other method that would allow me to provide the path in a way that the workbench could be triggered just by a python script and there would be no need to open the fmw files in FME Desktop

Hey all, Quick question. Does anyone know the difference between the free google geocoder and using an enterprise API key within this transformer? I thought there was a limit on the number of addresses you could geocode per day on the free version, but I ran 5,000 through multiple times. If the free version within FME is the same as the enterprise api my company pays for I could tell them to cancel our subscription. Does anyone have any thoughts on this? Is the enterprise API more accurate? Thanks again! Ethan

reading jpegs - speed

Hello, I have a workspace that extracts gps data from geotagged photos. In order to do this fme has to read in each file. I just want to create points with a link to the photo, so I remove the geometry straight away. The problem is that the workspace takes a long time to run, reading hunrdreds of jpegs. Is there a way just to read the exif metadata somehow to speed things up? Thanks, Owen

dBase tables including .dbt-files are not prozessed?

When reading from dbase-Tables FME skips processing them when there is also a .dbt file (because of memo-fields including more than 254 characters in the dbase-table)Does anybody knows how to solve this problem?

Converting Cells from V8 microstation to v7 microstation

Hi everybody ,I need help again. I'm trying to transform a map from V8 to V7 of microstation , and I find that the cells aren't not converted.I put a jpg of the diagram that I'm using and the excels of the schemaMappers.The idea is than , in function of the value of a level in V8 I assing the attribute level , and take the same attributes of the input.In the conversion it seems to work OK , but in map of the output doesn't appears nothing , no cells.I put the schema in FME and a sample of the excel of the schemaMapper.Thanks for your help !!!

Converting from V8 to V7 of Microstation

Hi Everybody ,Anybody knows what is the procedure to convert a map from V8 of microstation to V7 of microstation ???.I have added a writer from V8 (A map that contains all the elements in V8) , and I have added a output in V7 , but I see that , If I try to configure it by geometry , doesn't appears the names of the geometry , appears Numbers , in this case , 1 for cells , 2 for lines ... etc.The diagram executed seems to work OK , write all the features but when I open the DGN file in V7 there isn't nothing , no elements.Any idea ??? , thanks in advanced for your help !!!I leave the log of the translation ...

Workspace hangs while reading from MS SQL Server

In my workspace I am reading from a table in SQL Server. There is a huge amount of records, so I limit the number of records to read (per feature type) to 100k for testing purposes. When the number of features read gets to about 99000, the workspace does not proceed for about 15 minutes. Is there anything I can change here?

8 years ago

xavigarciamar

asked in Data

Map feature Class Arcgis from microstation V8

Hi everybody ,I need to know how with a SchemaMapper and a attributefilter can I map the ouput of arcgis of a feature class in function of a level of input in Microstation V8.I will explain better , I have a Excel with this columns : igds_level 501000 lines Menu1000/ComunicacionsLin igds_level 501001 lines Menu1000/ComunicacionsLin igds_level 501000 lines Menu1000/ComunicacionsLin igds_level 501010 lines Menu1000/ComunicacionsLin igds_level 501011 lines Menu1000/ComunicacionsPunt igds_level 501010 lines Menu1000/ComunicacionsLinAnd in function of the igds_level of the input V8 of microstation I need to put the feature in one feature Class or another , in this case , for example , the feature with level 501010 must go to feature class of output of arcgis ComunicacionsLin , if I have the in the input igds_level 501011 will go this feature to feature class ARcgis ComunicacionsPunt.I know that with a schemaMapper a

8 years ago

jstanger

asked in Data

Assign writer coordinate system based on processed input data

I'm required to export some spatial data to AutoCAD. The incoming data exists anywhere in Australia and the exported data needs to be in one of the MGA94 zones. The client refuses the suggestion that they select one of the possible 10 projection zones to correctly reproject the data and claims FME should be able to handle this automatically.Is there a way to modify the AutoCAD writer coordinate system after the FME workspace has been launched (i.e. after I've started reading in data) so that I can correctly export to the zone that corresponds to the input data?I can see one way if I can get a transformer to replace the value in a public or private parameter. Is this possible?

540

8 years ago

tim_woodContributor

asked in Data

Using FileCopy Writer to move FGDB - source folder gets left behind

I want to move an ESRI File Geodatabase (FGDB) from one folder to another. I have got the FileCopy Writer to move ...\\here\\data.gdb\\*.* to ..\\there\\data.gdb\\*.* but this leaves the now empty ..\\here\\data.gdb folder in the original location. I suspect this is because FGDBs are actually folders which is confusing for non-ESRI stuff (to the FileCopy Writer, it's just another folder). I know I could probably solve this with Python, or something involving Workspace Runners and FileCopy to nul to delete the folder after moving the contents. But I wondered if anyone knows of a way of doing this within the FileCopy Writer as part of the Move operation.Before you suggest doing ..\\here\\*.gdb, the constraint is that ..\\here\\ may contain more than one FGDB, but I only want to move one at a time. This is because I'm processing each FGDB in turn then moving it to a "processed" folder.I've also got an idea of writing the FGDB names (the names are dynamic) to a te

1240

8 years ago

lazarlubomirContributor

asked in Data

Canvas export to Raster

Hello,please help me... I need to export canvas to raster to present my solution... Its quite big canvas and I need it in nice form in PDG, JPEG or others formats. I installed virtual PDF printer, but FME still export canvas in 30 A4 instead my specific format size... Has anybody experiences with this please?Thank You very muchLuboš

microstation resource font file crashing workbench

Hi,I am translating autocad dwg file to microstation dgn file, where I am also writing Tag attributes to dgn elements.However as soon as I assign Resource Font file ( a .rsc file) in the writer advance parameters the workbench crashes, if I remove the resource font file the workbench works fine.I have attached a screenshot.FME - 2016.1Microstation version - V 8.00.04.01Please suggest.RegardsZubair

8 years ago

michaels

asked in Data

How can I use Published Parameters in an WFS Filter?

Hican anyone halep me? I have a chanllange to solve.I have a WFS-Reader with different features (Houses, Streets, Trees). All of this feature contain a identical attribute (Commune_ID).Now I like to use the filter because I need only the data from one commune (on the Source-WFS are data from many many communes). So I give the Commune_ID as an Published Parameter to the workbench.How have I to form the XML Filter Expression that I get only the used data? But I need it from all 3 features.Thanks for your help

170

8 years ago

Page 212 / 274

Badge winners

arxit_cbuhas earned the badge German Speaker
arxit_cbuhas earned the badge French Speaker
arxit_cbuhas earned the badge English Speaker
verenahennershas earned the badge Webinar Watcher (Grey)
verenahennershas earned the badge Welcome Back

Show all badges

30,463: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.