Using readers and writers to extract and load data.
Recently active
Hi Everyone,A simple question i hope, but how can i use the right transformer, to ensure that a <gml:pos> is written in my CityGML? Currently a <gml:posList> element is written.Here is what i am getting:<bldg:lod2MultiSurface> <gml:MultiSurface srsName="EPSG:27700" srsDimension="3"> <gml:surfaceMember> <gml:Polygon> <gml:exterior> <gml:LinearRing> <gml:posList>555687.68 236458.51 216.48 555689.24 236454.66 214.32 555699.8 236458.94 214.35 555698.46 236462.26 216.21 555698.28 236462.72 216.47 555687.68 236458.51 216.48</gml:posList> </gml:LinearRing> </gml:exterior> </gml:Polygon> </gml:surfaceMember> </gml:MultiSurface></bldg:lod2MultiSurface>
Hi!I am trying to transform a dxf-file from SWEREF99 13 30 to SWEREF99 TM. I simply set the coordinatesytem to the one I want in the writer and executes. The result is a file that is more than ten times as big as the original. Why is this?Thankyou.
Hello,I have a kmz file and i would like to extract the name folder - Attached.Thanks, - Danilo
What is Maximum file size that i can upload to FME Shared Resource Data Folder?How can i limit or configure this file size?
Hi everyone,I am very new to FME having recently downloaded a free trial, so please bear with me.I work on a civil engineering project and the majority of our design data (AutoCAD 2013 DWG) is on the OSGB36 grid (Ordnance Survey Great Britain).To transform it to our local site grid I applied a series of modifiers (scaler, rotater, offsetter) then set a writer to output as DWG.We tested it with the largest of our model files and found that the output file was around 800Mb in size whereas the input file was only 200Mb. Does anyone have any idea why this could be happening?I am an Engineering Surveyor so I am rather unfamiliar with AutoCAD beyond simple commands & geometry etc, so the settings in the reader / writer don't mean much to me either!Thanks in advance for any help or advice.John R
I've built a Workspace to process an export file from a GIS system with the following structure:Layer name + comma separated attributesUnique ID (like ESRI Object ID)X YX YX YLayer name + comma separated attributesUnique ID (like ESRI Object ID)X YX YX YIf the last X and Y are the same as the first for that feature, it's a polygon layer, otherwise it's a line. Point layers have the X and Y as part of the layer name and comma separated attributes line.I extract the Unique ID for each feature and add it to the rows that are part of that feature. I then split the attribute rows from the vertex rows. Vertex rows go through the LineBuilder which outputs the results through the Point, Line, or Polygon port as appropriate.Based on which port the data comes out of, I'd then like to set the geometry type as an attribute or parameter to use in the Writer when I create the File Geodatabase feature class. I'm aware that I would need to use drop and create as trying to inser
Hi FME,Need the following help with the workflow:1. From our UI user is allowed to add only DWG and DGN file2. We want an if else statement so that if the users upload dwg, then FME can run the dwg converter workbench and if they upload dgn it runs a different dgn converter workbench. There must be some simple approach for this. Please share your suggestion.Thank you in advance..Regards,Ranjit
Hello,I am a FME beginner and I really love that whole folders can be added to a writer. However, I do have folders which contain many files of the same format each and I would like to add a folder to a reader and let FME guess the format of the files in that folder. It seems that this is not possible but only one of the two (add folder OR guess format from dataset)?thanks and best regards,Ludwig
Hi,I would like to write to elasticsearch, not from a table but from some JSON instead. I have prepared the JSON before hand because it has to be nested.The output format is like so:{ "mappings": { "storymap": { "properties": { "storyname": { "type": "text" }, "storyid": { "type": "integer" }, "storyjson": { "type": "text" }, "categoryname": { "type": "text" }, "subcategoryname": { "type": "text" }, "regions": { "type": "nested", "properties": { "region_id": { "type": "integer" } } } } } }} I have managed to get this output format using the JSONTemplater - thanks to @petrahammoser your post was helpful. But now I want to pass the JSON to an index in elasticsearch which is already created.I have tried but I am at a loss, the JSON do
Hi,While running job on FME Server I noticed it is getting restarted.Workspace I'm trying to run has Smallworld reader and GML writer (+few attribute manipulation transformers). It starts at e.g. 10:00, and after a few time Smallworld console returns stream exhausted traceback at e.g. 10:42. At the same time my job (started at 10 o'clock) is now running and started at 10:42.This repeats itself few time when it finally gives failure status with no description in log of that job.If I run same workspace in Desktop it results in FME.exe crash.Thanks,Želimir
Hi,I have just a 6 points ( attached ) and i would like to generate a kml file using the service KML Network Link.Each point has a number of sequence ( _feature_n ) to show each 30 seconds.How is the best way to do this? Thanks, - Danilo
We have a requirement to produce a report on a monthly basis, the workbench literally just reads a sql view, re-orders the results and outputs to excel.The workbench works using desktop and Server when manually run, however when scheduling the workbench fails with the following error;Excel Writer: No active sheet set, cannot write to the spreadsheet. This is an internal error, please contact support@safe.com I have attached the log file.System information-FME Server 2017.0.1.1 - Build 17291 - win64Running on Windows Server 2012 R2 Standard
Do you think there is a way in FME to extract traffic layer from Google? I want to analyze traffic in a certain zone and I can't find the way to get this data in FME.I tried to see into the documentation but without success : Google TrafficI'm starting to think that maybe Google doesn't want us to do that kind of stuff though...
Hello all. I am attempting to validate the use of this noble cause called FME. While appreciating your time I submit the following:A need has arisen to retrieve the PNEZD (point#, northing, easting, elevation, description) and all of the attributes of each cogo point in a Civil 3D drawing. We can have up to 17 attributes for each point. Is this do-able? If so we could automate the extraction of thousands of points from numerous drawings and life would be swell.
I have the logs which contain multiple warnings, including: " Could not overwrite existing destination file, since it is also the template file". When attempting to open the excel file after running the workbench it first displays an error message, then when you click past it there is another notification claiming another 'unknown' user is in the document. When clicking 'Read only' you can see the whole spreadsheet is broken i.e. all formatting lost
Hi,I am trying to connect to my AWS elasticache servicehttps://search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com/I can go here on a web page and it returns:{"name": "dF9fcow","cluster_name": "929479087525:dev-elasticsearch","cluster_uuid": "Owj46HL6TpSWiGnOeYeCaw","version": {"number": "5.1.1","build_hash": "5395e21","build_date": "2016-12-15T22:47:19.049Z","build_snapshot": false,"lucene_version": "6.3.0"},"tagline": "You Know, for Search"}But for some reason FME cannot connect, it appears to be trying over port 9200.This is the error I get:ELASTICSEARCH writer: CURL error was: Failed to connect to search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com port 9200: Connection refusedELASTICSEARCH writer: Unable to locate or open server 'https://search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com'. Please ensure the server exists and is accessible. Note that the ELASTICSEARCH writer does not have the abilit
Hi, FuzzyStringComparer is a great transformer but it only works within one dataset. Has anyone created a method of doing the same with two datasets? I have done a feature merge on two streetname lists. As output I now have two lists which contain streetnames that are missing/wrong in either list. So I would like to continue by doing a fuzzy comparison and return to ListA the most probable candidate from ListB for each attribute. It is likely there are just typos, and I will then find them. Where the probability is very low the streetname is most likely missing completely or superfluous in either list which is also useful information. Thanks for any ideas how to proceed...
My company receive AddressBasePremium from OS via disc, the data is stored in zipped GML files and has previously been pretty good to work with, however we may have changed some settings that appear to be affecting our ability to open GML files in desktop or the data inspector, the following error is thrown when attempting to view the data (freshly extracted from disc) in the inspector;URL resource cache - 'attempt to write a readonly database'A fatal error has occurred. Check the logfile above for detailsFailed to read features from dataset 'E:\\Temp\\AddressBasePremium_FULL_2017-07-03_099_gml\\AddressBasePremium_FULL_2017-07-03_099.gml' using the 'GML' readerI can't find anything that may be causing this, can anybody offer some assistance? I understand FME will be creating a temporary database for the tabular GML information so assume this may be permission issues, but my user account is a local admin.
Hello everyoneI would like to know if with a dgn V8, it is possible to create space model centered on the rights of the main file At the same time that the file dgn is created thank you
Ok, I've a gpx file that I see in the data inspector, I have a mapbox map in the background that I can see too. I want to save this out to a jpeg but it doesn't create any file so I tried saving dataset as a pdf. That works, except it only exports the gpx data, it doesn't include the background map. Is there a way to do this?
Hello,I have a route in GoogleMaps and i would like to extract in KML format:RouteThanks,Danilo
I'm trying to map a Smallworld table to a different schema in our Postgres SDE. I have one Excel file with the schema for the writer and another Excel file with a worksheet for mapping from the smallworld field to the fields that exist in the schema for the writer. This works when I translate to ffs (even though I get some error messages). But when I use the same workspace to translate to Postgres SDE it fails. Eventually I will need to map multiple Smallworld tables to the Postgres SDE. I have attached the workspace, the log file and the two Excel files. I'm wondering if having two excel files is part of the problem. But when I tried to accomplish all this with a single Excel file I was getting errors. Thoughts?
I am unable to add generic reader. My requirement is to read multiple files of two formats i.e *.dwg and *.dgn with dynamic schema.I am able to add simple generic reader with single value like one dwg file.Thanks in advance.Getting the following error in translation log.Generate requires an even number of arguments -- received arguments `C:\Program Files\FME\fmeworker.exe' `GENERATE' `GENERIC' `NULL' `C:\ProgramData\Safe Software\FME Server\resources\data\user\*.dwg' `C:\ProgramData\Safe Software\FME Server\resources\data\user\*.dgn' `C:\Users\username\AppData\Local\Temp\FME_1503658297685_15148.fmw' `+MERGE_SCHEMAS' `YES' `--SourceREAL_FORMAT' `GUESS_FROM_EXTENSION' `LOG_STANDARDOUT' `YES'Program TerminatingTranslation FAILED.Defining the path in GENERIC Reader as follows:"C:\ProgramData\Safe Software\FME Server\resources\data\anyfolder\*.dwg" "C:\ProgramData\Safe Software\FME Server\resources\data\anyfolder\*.dgn"
I've still learning how to use the HTTP Caller and wanted to see if what I'm attempting to do would be possible. I believe I need to use the POST method to pick the parameters and also upload the file. There is no API for this site unfortunately. I'm just not quite sure how to configure the HTTP Caller. Any help would be greatly appreciated!Website: https://www.ngs.noaa.gov/OPUS/HTTP Request I captured after manually submitting from the site