Using readers and writers to extract and load data.
Recently active
Hi All,I have a text file with a variable quantity of lines, separated by an empty line. The lines adjacent to one another need to be grouped together and then concatenated. So for example:Test1Test2Test3---testy1testy2---test---(where the hyphens are the blank lines, I can't format this page with return lines it seems)Would need to become:Test1 Test2 Test3testy1 testy2testI've tried to do this a couple of ways so far, and variables seemed to be the right choice initially but now I'm not so sure. As I also have a format attribute on each line that contains the text_line_length, I was trying to use this as the delimiter when it was = to 0. It's interesting because the logic is a bit like using the PointConnector to create line geometries and what I need is to use the text_line_length as the 'connection break attribute'. Anyway, that's a digression. Does anyone have any simple tricks I could deploy to do this?Thanks, Dave
Hi,I am trying to connect to our Oracle 11g Spatial Data using FME however the Oracle Spatial Object reader returns the following when trying to retrieve a list of tables:"Failed to retrieve feature types"I know there are spatial tables present as I can view the data in Arcmap, the log file simply states:"universalreader -- readschema resulted in 0 schema features being returned."Strangely if I read in a shapefile and output this as an Oracle Spatial Table to the same database this then shows and returns the correct spatial data, however I then receive the error below trying to use this in Arcmap:"Error opening feature classLayer not foundLayer not found"This is my first post so apologies if I have missed off any crucial information, thanks in advance for any help on this.Thanks,Charlie
I have a column given to me in a spreadsheet which looks like that:What I need is to get all the references out, the ones in square brackets, to provide with the full list to a user:An then get a full list of all references, as follows:Does anyone have an idea of how I can do this using FME?
If this is the case, then writing 3D coordinates would be very interesting in future releases given the 3D developments in the ESRI JS API 4.x.
Hi,i have some pdf docs residing in Folders. From GoogleEarth I would like to open them by clicking on a hyperlink. Some years back I managed to do that, unfortunately I do not remenber very well how.What I remember is to use the a-tag and the href attribute.So far I did the following:As a result I see the "Link to pdf" appearing as a blue underlined hyperlink. But opening the document fails.I also tried to prefix the "D:xxx" with file://D:xx but it also did not work. The resulting kml file and the pdf folfer with the documents do not reside in the same folder.Any ideas?
Hi,I want to trigger a workspace using a python script and with that, also want to set the reader dynamically as a parameter. I did look at a few posts previously on this subject like using the workspace runner or the Creator but wasn't sure if that would match my requirement.My requirement is that - I have a set of workbenches that already have a Reader transformer added but I want to override those readers through Python script and provide dataset paths through python script.It would be great help if I am advised whether I am trying this the wrong way and if I should be getting rid of the Readers from all my fmw files and take some other method that would allow me to provide the path in a way that the workbench could be triggered just by a python script and there would be no need to open the fmw files in FME Desktop
Hey all, Quick question. Does anyone know the difference between the free google geocoder and using an enterprise API key within this transformer? I thought there was a limit on the number of addresses you could geocode per day on the free version, but I ran 5,000 through multiple times. If the free version within FME is the same as the enterprise api my company pays for I could tell them to cancel our subscription. Does anyone have any thoughts on this? Is the enterprise API more accurate? Thanks again! Ethan
Hello, I have a workspace that extracts gps data from geotagged photos. In order to do this fme has to read in each file. I just want to create points with a link to the photo, so I remove the geometry straight away. The problem is that the workspace takes a long time to run, reading hunrdreds of jpegs. Is there a way just to read the exif metadata somehow to speed things up? Thanks, Owen
When reading from dbase-Tables FME skips processing them when there is also a .dbt file (because of memo-fields including more than 254 characters in the dbase-table)Does anybody knows how to solve this problem?
Hi everybody ,I need help again. I'm trying to transform a map from V8 to V7 of microstation , and I find that the cells aren't not converted.I put a jpg of the diagram that I'm using and the excels of the schemaMappers.The idea is than , in function of the value of a level in V8 I assing the attribute level , and take the same attributes of the input.In the conversion it seems to work OK , but in map of the output doesn't appears nothing , no cells.I put the schema in FME and a sample of the excel of the schemaMapper.Thanks for your help !!!
Hi Everybody ,Anybody knows what is the procedure to convert a map from V8 of microstation to V7 of microstation ???.I have added a writer from V8 (A map that contains all the elements in V8) , and I have added a output in V7 , but I see that , If I try to configure it by geometry , doesn't appears the names of the geometry , appears Numbers , in this case , 1 for cells , 2 for lines ... etc.The diagram executed seems to work OK , write all the features but when I open the DGN file in V7 there isn't nothing , no elements.Any idea ??? , thanks in advanced for your help !!!I leave the log of the translation ...
In my workspace I am reading from a table in SQL Server. There is a huge amount of records, so I limit the number of records to read (per feature type) to 100k for testing purposes. When the number of features read gets to about 99000, the workspace does not proceed for about 15 minutes. Is there anything I can change here?
Hi everybody ,I need to know how with a SchemaMapper and a attributefilter can I map the ouput of arcgis of a feature class in function of a level of input in Microstation V8.I will explain better , I have a Excel with this columns : igds_level 501000 lines Menu1000/ComunicacionsLin igds_level 501001 lines Menu1000/ComunicacionsLin igds_level 501000 lines Menu1000/ComunicacionsLin igds_level 501010 lines Menu1000/ComunicacionsLin igds_level 501011 lines Menu1000/ComunicacionsPunt igds_level 501010 lines Menu1000/ComunicacionsLinAnd in function of the igds_level of the input V8 of microstation I need to put the feature in one feature Class or another , in this case , for example , the feature with level 501010 must go to feature class of output of arcgis ComunicacionsLin , if I have the in the input igds_level 501011 will go this feature to feature class ARcgis ComunicacionsPunt.I know that with a schemaMapper a
I'm required to export some spatial data to AutoCAD. The incoming data exists anywhere in Australia and the exported data needs to be in one of the MGA94 zones. The client refuses the suggestion that they select one of the possible 10 projection zones to correctly reproject the data and claims FME should be able to handle this automatically.Is there a way to modify the AutoCAD writer coordinate system after the FME workspace has been launched (i.e. after I've started reading in data) so that I can correctly export to the zone that corresponds to the input data?I can see one way if I can get a transformer to replace the value in a public or private parameter. Is this possible?
I want to move an ESRI File Geodatabase (FGDB) from one folder to another. I have got the FileCopy Writer to move ...\\here\\data.gdb\\*.* to ..\\there\\data.gdb\\*.* but this leaves the now empty ..\\here\\data.gdb folder in the original location. I suspect this is because FGDBs are actually folders which is confusing for non-ESRI stuff (to the FileCopy Writer, it's just another folder). I know I could probably solve this with Python, or something involving Workspace Runners and FileCopy to nul to delete the folder after moving the contents. But I wondered if anyone knows of a way of doing this within the FileCopy Writer as part of the Move operation.Before you suggest doing ..\\here\\*.gdb, the constraint is that ..\\here\\ may contain more than one FGDB, but I only want to move one at a time. This is because I'm processing each FGDB in turn then moving it to a "processed" folder.I've also got an idea of writing the FGDB names (the names are dynamic) to a te
Hello,please help me... I need to export canvas to raster to present my solution... Its quite big canvas and I need it in nice form in PDG, JPEG or others formats. I installed virtual PDF printer, but FME still export canvas in 30 A4 instead my specific format size... Has anybody experiences with this please?Thank You very muchLuboš
Hi,I am translating autocad dwg file to microstation dgn file, where I am also writing Tag attributes to dgn elements.However as soon as I assign Resource Font file ( a .rsc file) in the writer advance parameters the workbench crashes, if I remove the resource font file the workbench works fine.I have attached a screenshot.FME - 2016.1Microstation version - V 8.00.04.01Please suggest.RegardsZubair
Hican anyone halep me? I have a chanllange to solve.I have a WFS-Reader with different features (Houses, Streets, Trees). All of this feature contain a identical attribute (Commune_ID).Now I like to use the filter because I need only the data from one commune (on the Source-WFS are data from many many communes). So I give the Commune_ID as an Published Parameter to the workbench.How have I to form the XML Filter Expression that I get only the used data? But I need it from all 3 features.Thanks for your help
What would be the best way of reading a file on an ftp site which name keeps changing every week. The beginning of the file name always stays the same. Is it possible to start a shell script from FME to firs download the data set?
Hi,how can i give folders in kml a description with FME? I was only able to give a description to the document and the placemarks.In the screenshot, Number 1 is generated with ArcGis, Number 2 by FME with the missing folder description. Thanks for all help in advance!
I'm wondering if anyone has any experience connecting FME to an ArcGIS Online account that has "AD Account" permissions turned on? The AGOL Org. I am trying to reach allows government employees to log in using their PIV Card/Government Network username/password OR an ArcGIS Account. I believe this may be causing FME to fail at the authentication step. When I attempt to read data from AGOL using my ArcGIS.com username/password I am getting an error code 400 which states that it was unable to generate token and something about my username and password being incorrect.At this point I can only speculate but I'm wondering if FME is trying to use my ArcGIS.com account with the AD Account login.Anyway, I thought reach out here to see if anyone else might have any experience here. Thanks in advance for any ideas you might have.~Ben Ben Butler Wildfire GIS Specialist USDA Forest Service - RMRS Wildland Fire Management RD&A; bbutler@firenet.gov
Hi,If I find an error in the 2017 beta (build 17160), how/where/to whom do I submit that ?Here, or are there special emails/forums for that ?Cheers Lars I.
Hi all, I was able to get a list of completed jobs with jot status codes from the fme_job_history table. But where can I find the job status lookup table?
I use a csv reader to read a csv file. Unfortunately this csv file contains line breaks in some records (CRLF). This causes a record to be split into more than one, which is undesirable. Is there a way for the reader to ignore these linebreaks?
i have shape file. it has named as roads.what i want need a. design file.how to name the same of the shape file.no additional attributes want just conversion is enough.i also do shape to shape conversion the names..please anyone help Thanks in Advance