Using readers and writers to extract and load data.
Recently active
Hello,I am a FME beginner and I really love that whole folders can be added to a writer. However, I do have folders which contain many files of the same format each and I would like to add a folder to a reader and let FME guess the format of the files in that folder. It seems that this is not possible but only one of the two (add folder OR guess format from dataset)?thanks and best regards,Ludwig
Hi,I would like to write to elasticsearch, not from a table but from some JSON instead. I have prepared the JSON before hand because it has to be nested.The output format is like so:{ "mappings": { "storymap": { "properties": { "storyname": { "type": "text" }, "storyid": { "type": "integer" }, "storyjson": { "type": "text" }, "categoryname": { "type": "text" }, "subcategoryname": { "type": "text" }, "regions": { "type": "nested", "properties": { "region_id": { "type": "integer" } } } } } }} I have managed to get this output format using the JSONTemplater - thanks to @petrahammoser your post was helpful. But now I want to pass the JSON to an index in elasticsearch which is already created.I have tried but I am at a loss, the JSON do
Hi,While running job on FME Server I noticed it is getting restarted.Workspace I'm trying to run has Smallworld reader and GML writer (+few attribute manipulation transformers). It starts at e.g. 10:00, and after a few time Smallworld console returns stream exhausted traceback at e.g. 10:42. At the same time my job (started at 10 o'clock) is now running and started at 10:42.This repeats itself few time when it finally gives failure status with no description in log of that job.If I run same workspace in Desktop it results in FME.exe crash.Thanks,Želimir
Hi,I have just a 6 points ( attached ) and i would like to generate a kml file using the service KML Network Link.Each point has a number of sequence ( _feature_n ) to show each 30 seconds.How is the best way to do this? Thanks, - Danilo
We have a requirement to produce a report on a monthly basis, the workbench literally just reads a sql view, re-orders the results and outputs to excel.The workbench works using desktop and Server when manually run, however when scheduling the workbench fails with the following error;Excel Writer: No active sheet set, cannot write to the spreadsheet. This is an internal error, please contact support@safe.com I have attached the log file.System information-FME Server 2017.0.1.1 - Build 17291 - win64Running on Windows Server 2012 R2 Standard
Do you think there is a way in FME to extract traffic layer from Google? I want to analyze traffic in a certain zone and I can't find the way to get this data in FME.I tried to see into the documentation but without success : Google TrafficI'm starting to think that maybe Google doesn't want us to do that kind of stuff though...
Hello all. I am attempting to validate the use of this noble cause called FME. While appreciating your time I submit the following:A need has arisen to retrieve the PNEZD (point#, northing, easting, elevation, description) and all of the attributes of each cogo point in a Civil 3D drawing. We can have up to 17 attributes for each point. Is this do-able? If so we could automate the extraction of thousands of points from numerous drawings and life would be swell.
I have the logs which contain multiple warnings, including: " Could not overwrite existing destination file, since it is also the template file". When attempting to open the excel file after running the workbench it first displays an error message, then when you click past it there is another notification claiming another 'unknown' user is in the document. When clicking 'Read only' you can see the whole spreadsheet is broken i.e. all formatting lost
Hi,I am trying to connect to my AWS elasticache servicehttps://search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com/I can go here on a web page and it returns:{"name": "dF9fcow","cluster_name": "929479087525:dev-elasticsearch","cluster_uuid": "Owj46HL6TpSWiGnOeYeCaw","version": {"number": "5.1.1","build_hash": "5395e21","build_date": "2016-12-15T22:47:19.049Z","build_snapshot": false,"lucene_version": "6.3.0"},"tagline": "You Know, for Search"}But for some reason FME cannot connect, it appears to be trying over port 9200.This is the error I get:ELASTICSEARCH writer: CURL error was: Failed to connect to search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com port 9200: Connection refusedELASTICSEARCH writer: Unable to locate or open server 'https://search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com'. Please ensure the server exists and is accessible. Note that the ELASTICSEARCH writer does not have the abilit
Hi, FuzzyStringComparer is a great transformer but it only works within one dataset. Has anyone created a method of doing the same with two datasets? I have done a feature merge on two streetname lists. As output I now have two lists which contain streetnames that are missing/wrong in either list. So I would like to continue by doing a fuzzy comparison and return to ListA the most probable candidate from ListB for each attribute. It is likely there are just typos, and I will then find them. Where the probability is very low the streetname is most likely missing completely or superfluous in either list which is also useful information. Thanks for any ideas how to proceed...
My company receive AddressBasePremium from OS via disc, the data is stored in zipped GML files and has previously been pretty good to work with, however we may have changed some settings that appear to be affecting our ability to open GML files in desktop or the data inspector, the following error is thrown when attempting to view the data (freshly extracted from disc) in the inspector;URL resource cache - 'attempt to write a readonly database'A fatal error has occurred. Check the logfile above for detailsFailed to read features from dataset 'E:\\Temp\\AddressBasePremium_FULL_2017-07-03_099_gml\\AddressBasePremium_FULL_2017-07-03_099.gml' using the 'GML' readerI can't find anything that may be causing this, can anybody offer some assistance? I understand FME will be creating a temporary database for the tabular GML information so assume this may be permission issues, but my user account is a local admin.
Hello everyoneI would like to know if with a dgn V8, it is possible to create space model centered on the rights of the main file At the same time that the file dgn is created thank you
Ok, I've a gpx file that I see in the data inspector, I have a mapbox map in the background that I can see too. I want to save this out to a jpeg but it doesn't create any file so I tried saving dataset as a pdf. That works, except it only exports the gpx data, it doesn't include the background map. Is there a way to do this?
Hello,I have a route in GoogleMaps and i would like to extract in KML format:RouteThanks,Danilo
I'm trying to map a Smallworld table to a different schema in our Postgres SDE. I have one Excel file with the schema for the writer and another Excel file with a worksheet for mapping from the smallworld field to the fields that exist in the schema for the writer. This works when I translate to ffs (even though I get some error messages). But when I use the same workspace to translate to Postgres SDE it fails. Eventually I will need to map multiple Smallworld tables to the Postgres SDE. I have attached the workspace, the log file and the two Excel files. I'm wondering if having two excel files is part of the problem. But when I tried to accomplish all this with a single Excel file I was getting errors. Thoughts?
I am unable to add generic reader. My requirement is to read multiple files of two formats i.e *.dwg and *.dgn with dynamic schema.I am able to add simple generic reader with single value like one dwg file.Thanks in advance.Getting the following error in translation log.Generate requires an even number of arguments -- received arguments `C:\Program Files\FME\fmeworker.exe' `GENERATE' `GENERIC' `NULL' `C:\ProgramData\Safe Software\FME Server\resources\data\user\*.dwg' `C:\ProgramData\Safe Software\FME Server\resources\data\user\*.dgn' `C:\Users\username\AppData\Local\Temp\FME_1503658297685_15148.fmw' `+MERGE_SCHEMAS' `YES' `--SourceREAL_FORMAT' `GUESS_FROM_EXTENSION' `LOG_STANDARDOUT' `YES'Program TerminatingTranslation FAILED.Defining the path in GENERIC Reader as follows:"C:\ProgramData\Safe Software\FME Server\resources\data\anyfolder\*.dwg" "C:\ProgramData\Safe Software\FME Server\resources\data\anyfolder\*.dgn"
I've still learning how to use the HTTP Caller and wanted to see if what I'm attempting to do would be possible. I believe I need to use the POST method to pick the parameters and also upload the file. There is no API for this site unfortunately. I'm just not quite sure how to configure the HTTP Caller. Any help would be greatly appreciated!Website: https://www.ngs.noaa.gov/OPUS/HTTP Request I captured after manually submitting from the site
Hello,I have some cell references in one spreadsheet, eg 'F4', what I need to do it extract the value of that cell from another spreadsheet.I know that you can expose the xlsx row id, but I cant see a way of getting the column id/number. Any suggestions would be welcome.If not is can I create one by using a schema reader?Thanks, Owen
I am using the XML Templater to transform data from a shapefile into an xml document. The Transformer creates one complete xml child node for each dataset perfectly. But this is not a complete xml file because I still need to add additional header information into the final XML Document before it is ready to be used in another application. In other words, I need to insert my XML Nodes into a Wrapper document. AM I able to do this with the XML-Templater or do I need to use an additional transformer?Think of it like this.My Templater creates this:<parent> <child> <value> </child> <child> <value> </child></parent>But I need:<?xml version="1.0" encoding="utf-8"?><CABS_BPLAN_Records xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ikxBase="http://schemas.webs.idu.de/cardo3/Ikx/IkxBase" xsi:schemaLocation="http://www.cardogis.com/ikx/schema/HEIDEKREIS/Exchange puzzle.xsd" xmlns="http://www.cardogis.com/ikx/schema/HEIDEKRE
Hi,Does anybody have any experience in writing hyperlinks in an Autocad DWG?The only mention in the documentation is rather sketchy and doesnt help much :Shttp://docs.safe.com/fme/2015.1/html/FME_Desktop_D...Any tips or info are welcome.Itay
From this Q&A;: Geojson reader-encoding issueThe Source URL: http://stadtplan.bonn.de/geojson?Thema=14403&koordsys;=25832/geojson.jsonI think there is a room to improve GeoJSON handling.The GeoJSON reader should support various encodings.The GeoJSON reader and the GeometryReplacer (Geometry Encoding: GeoJSON) should set an appropriate coordinate system to the geometry if the "geometry" member object contains a valid "crs" member, like this.{ "type" : "FeatureCollection", "features" : [ { "type" : "Feature", "geometry" : { "type" : "Point", "crs" : { "type" : "name", "properties" : { "name" : "EPSG:25832" } }, "coordinates" : [ 369127.5691, 5624581.982 ] }, "properties" : {...
The URL for the reader is : https://itportal.decc.gov.uk/arcgis/services/OGA_Public_WGS84/OGA_Quadrants_WGS84/MapServer/WFSServer?request=GetCapabilities&service;=WFSThe XML for all the relevant URLs in the log file appear OK to me, and no errors are being reported (not even any warnings).
Hi all,I am using FeatureWriter to update an existing Feature Class that lives in my SDE. Versioning is enabled. The Transaction Type is a Versioned Edit Session and my Writer Mode is Insert. I have Drop Table as No and Truncate Table as Yes. Essentially I want to replace the old FC with the new one I am creating.I noticed the writing was taking a while, and it seems like it eventually times out. Maybe this is the case, I want to double check with the community.The full error message is:"An error occurred while attempting to store a row into the table 'SDE.XXXX'. The error number from ArcObjects is: '-2147154945'. The error message from ArcObjects is: {Table schema changes after cursor declared [42000:[Microsoft][SQL Server Native Client 11.0][SQL Server]Could not complete cursor operation because the table schema changed after the cursor was declared.] [DB.SDE.XXXX]}"To note: I am not touching anything while this process is running. Thanks!
Can anybody tell me how to do the following?I am trying to shoot video or take LOTS of pics and stitch together with my LiDAR point cloud....this way it is like Google Streetview but with cm measurable quality