Using readers and writers to extract and load data.
Recently active
Hi,I am trying to connect to my AWS elasticache servicehttps://search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com/I can go here on a web page and it returns:{"name": "dF9fcow","cluster_name": "929479087525:dev-elasticsearch","cluster_uuid": "Owj46HL6TpSWiGnOeYeCaw","version": {"number": "5.1.1","build_hash": "5395e21","build_date": "2016-12-15T22:47:19.049Z","build_snapshot": false,"lucene_version": "6.3.0"},"tagline": "You Know, for Search"}But for some reason FME cannot connect, it appears to be trying over port 9200.This is the error I get:ELASTICSEARCH writer: CURL error was: Failed to connect to search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com port 9200: Connection refusedELASTICSEARCH writer: Unable to locate or open server 'https://search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com'. Please ensure the server exists and is accessible. Note that the ELASTICSEARCH writer does not have the abilit
Hi, FuzzyStringComparer is a great transformer but it only works within one dataset. Has anyone created a method of doing the same with two datasets? I have done a feature merge on two streetname lists. As output I now have two lists which contain streetnames that are missing/wrong in either list. So I would like to continue by doing a fuzzy comparison and return to ListA the most probable candidate from ListB for each attribute. It is likely there are just typos, and I will then find them. Where the probability is very low the streetname is most likely missing completely or superfluous in either list which is also useful information. Thanks for any ideas how to proceed...
My company receive AddressBasePremium from OS via disc, the data is stored in zipped GML files and has previously been pretty good to work with, however we may have changed some settings that appear to be affecting our ability to open GML files in desktop or the data inspector, the following error is thrown when attempting to view the data (freshly extracted from disc) in the inspector;URL resource cache - 'attempt to write a readonly database'A fatal error has occurred. Check the logfile above for detailsFailed to read features from dataset 'E:\\Temp\\AddressBasePremium_FULL_2017-07-03_099_gml\\AddressBasePremium_FULL_2017-07-03_099.gml' using the 'GML' readerI can't find anything that may be causing this, can anybody offer some assistance? I understand FME will be creating a temporary database for the tabular GML information so assume this may be permission issues, but my user account is a local admin.
Hello everyoneI would like to know if with a dgn V8, it is possible to create space model centered on the rights of the main file At the same time that the file dgn is created thank you
Ok, I've a gpx file that I see in the data inspector, I have a mapbox map in the background that I can see too. I want to save this out to a jpeg but it doesn't create any file so I tried saving dataset as a pdf. That works, except it only exports the gpx data, it doesn't include the background map. Is there a way to do this?
Hello,I have a route in GoogleMaps and i would like to extract in KML format:RouteThanks,Danilo
I'm trying to map a Smallworld table to a different schema in our Postgres SDE. I have one Excel file with the schema for the writer and another Excel file with a worksheet for mapping from the smallworld field to the fields that exist in the schema for the writer. This works when I translate to ffs (even though I get some error messages). But when I use the same workspace to translate to Postgres SDE it fails. Eventually I will need to map multiple Smallworld tables to the Postgres SDE. I have attached the workspace, the log file and the two Excel files. I'm wondering if having two excel files is part of the problem. But when I tried to accomplish all this with a single Excel file I was getting errors. Thoughts?
I am unable to add generic reader. My requirement is to read multiple files of two formats i.e *.dwg and *.dgn with dynamic schema.I am able to add simple generic reader with single value like one dwg file.Thanks in advance.Getting the following error in translation log.Generate requires an even number of arguments -- received arguments `C:\Program Files\FME\fmeworker.exe' `GENERATE' `GENERIC' `NULL' `C:\ProgramData\Safe Software\FME Server\resources\data\user\*.dwg' `C:\ProgramData\Safe Software\FME Server\resources\data\user\*.dgn' `C:\Users\username\AppData\Local\Temp\FME_1503658297685_15148.fmw' `+MERGE_SCHEMAS' `YES' `--SourceREAL_FORMAT' `GUESS_FROM_EXTENSION' `LOG_STANDARDOUT' `YES'Program TerminatingTranslation FAILED.Defining the path in GENERIC Reader as follows:"C:\ProgramData\Safe Software\FME Server\resources\data\anyfolder\*.dwg" "C:\ProgramData\Safe Software\FME Server\resources\data\anyfolder\*.dgn"
I've still learning how to use the HTTP Caller and wanted to see if what I'm attempting to do would be possible. I believe I need to use the POST method to pick the parameters and also upload the file. There is no API for this site unfortunately. I'm just not quite sure how to configure the HTTP Caller. Any help would be greatly appreciated!Website: https://www.ngs.noaa.gov/OPUS/HTTP Request I captured after manually submitting from the site
Hello,I have some cell references in one spreadsheet, eg 'F4', what I need to do it extract the value of that cell from another spreadsheet.I know that you can expose the xlsx row id, but I cant see a way of getting the column id/number. Any suggestions would be welcome.If not is can I create one by using a schema reader?Thanks, Owen
I am using the XML Templater to transform data from a shapefile into an xml document. The Transformer creates one complete xml child node for each dataset perfectly. But this is not a complete xml file because I still need to add additional header information into the final XML Document before it is ready to be used in another application. In other words, I need to insert my XML Nodes into a Wrapper document. AM I able to do this with the XML-Templater or do I need to use an additional transformer?Think of it like this.My Templater creates this:<parent> <child> <value> </child> <child> <value> </child></parent>But I need:<?xml version="1.0" encoding="utf-8"?><CABS_BPLAN_Records xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ikxBase="http://schemas.webs.idu.de/cardo3/Ikx/IkxBase" xsi:schemaLocation="http://www.cardogis.com/ikx/schema/HEIDEKREIS/Exchange puzzle.xsd" xmlns="http://www.cardogis.com/ikx/schema/HEIDEKRE
Hi,Does anybody have any experience in writing hyperlinks in an Autocad DWG?The only mention in the documentation is rather sketchy and doesnt help much :Shttp://docs.safe.com/fme/2015.1/html/FME_Desktop_D...Any tips or info are welcome.Itay
From this Q&A;: Geojson reader-encoding issueThe Source URL: http://stadtplan.bonn.de/geojson?Thema=14403&koordsys;=25832/geojson.jsonI think there is a room to improve GeoJSON handling.The GeoJSON reader should support various encodings.The GeoJSON reader and the GeometryReplacer (Geometry Encoding: GeoJSON) should set an appropriate coordinate system to the geometry if the "geometry" member object contains a valid "crs" member, like this.{ "type" : "FeatureCollection", "features" : [ { "type" : "Feature", "geometry" : { "type" : "Point", "crs" : { "type" : "name", "properties" : { "name" : "EPSG:25832" } }, "coordinates" : [ 369127.5691, 5624581.982 ] }, "properties" : {...
The URL for the reader is : https://itportal.decc.gov.uk/arcgis/services/OGA_Public_WGS84/OGA_Quadrants_WGS84/MapServer/WFSServer?request=GetCapabilities&service;=WFSThe XML for all the relevant URLs in the log file appear OK to me, and no errors are being reported (not even any warnings).
Hi all,I am using FeatureWriter to update an existing Feature Class that lives in my SDE. Versioning is enabled. The Transaction Type is a Versioned Edit Session and my Writer Mode is Insert. I have Drop Table as No and Truncate Table as Yes. Essentially I want to replace the old FC with the new one I am creating.I noticed the writing was taking a while, and it seems like it eventually times out. Maybe this is the case, I want to double check with the community.The full error message is:"An error occurred while attempting to store a row into the table 'SDE.XXXX'. The error number from ArcObjects is: '-2147154945'. The error message from ArcObjects is: {Table schema changes after cursor declared [42000:[Microsoft][SQL Server Native Client 11.0][SQL Server]Could not complete cursor operation because the table schema changed after the cursor was declared.] [DB.SDE.XXXX]}"To note: I am not touching anything while this process is running. Thanks!
Can anybody tell me how to do the following?I am trying to shoot video or take LOTS of pics and stitch together with my LiDAR point cloud....this way it is like Google Streetview but with cm measurable quality
Hello,I am trying to parse an HTML page with FME 2014 but, after a bunch of tests, I do not succeed in decoding the rather simple <table> section of my HTML imput. I fear that my troubles come from the FME version I am currently using.I have indeed read many posts dealing with HTMLExtractor, HTML Table Reader but these transformers are only available in 2017 version (thanks to @takashi for all of them !).Can someone tell me if there is a way to decode HTML table section with 2014 version of FME and how ? I join a sample of the file I have been trying to decode (the <table> part is the only interesting section of this file).Any help would be really appreciated.Thanks a lot.
I am using an eval version of FME Workbench 2016. Threw the following error message when I have more than 2 Esri Geodatabase (File Geodb API) readers in my workspace. Anybody had the same issue?FME API version of module 'FILEGDB' matches current internal version (3.8 20160224)Error running translation.
I have run a task to get an attribute data from kml tag and successfully get an attribute table in data inspector but unable to save data as an ESRI Shapefile because of 0 data transform as log below. why? Features Read Summary=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-XQueryExtractor_QUERY_RESULTS 445==============================================================================Total Features Read 445=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- FFS to ESRISHAPE Statistics=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Input Features Transformed=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-==================
Hello,I would like to do a migration between Reader ( Oracle - No Spatial ) to Writer ( SQL Server ).The question is: Its possible to migrate all from Oracle ( primary keys, foreign keys, indexes , views ) to SQL Server? Thanks,Danilo
My shapefiles have attributes coded as short (integer with 6 digits) and FME2016 read them as long, so when I output them in a dynamic workflow, their width is 10.- If I manually force to short, they are 5 digits long, which is not OK...- If I manually force to number with 6 digits and precision 0, it is OK, but I can't do it dynamically with datasets of many shapefiles... This is since FME2016 supports the short/long etc. datatypes for shapefiles. With FME2015, my data was understood correctly as number with 6 digits, in dynamic workflows.Is it a bug or can I automatically force all such attributes to numbers with 6 digits ?
I have problem with creation DEM/elevation raster from ASCII XYZ. I've loaded ASCII XYZ using CSV. I've used transformers: VertexCreator, NumericRasterizer. Translation was SUCCESSFUL, but finally elevation doesn't exist. What can be wrong? In attachment I send fmw file.
HiI have a simple workbench that converts ASC > XYZ as below:fme ASC_to_XYZ.fmw --SourceDataset NT26SW.asc --DestDataset NT26SW.xyzHow can I make the workbench deal with a dynamic "SourceDataset" as sometimes I need to pass a gzipped version of the sourcefile. The example below with the ".asc.gz" sourcefile will not work. fme ASC_to_XYZ.fmw --SourceDataset NT26SW.asc.gz --DestDataset NT26SW.xyz I am trying to resist re-writing code that pre extracts the "asc.gz" file before passing to FME.Thanks,Mike