Using readers and writers to extract and load data.
Recently active
Hello,I have some cell references in one spreadsheet, eg 'F4', what I need to do it extract the value of that cell from another spreadsheet.I know that you can expose the xlsx row id, but I cant see a way of getting the column id/number. Any suggestions would be welcome.If not is can I create one by using a schema reader?Thanks, Owen
I am using the XML Templater to transform data from a shapefile into an xml document. The Transformer creates one complete xml child node for each dataset perfectly. But this is not a complete xml file because I still need to add additional header information into the final XML Document before it is ready to be used in another application. In other words, I need to insert my XML Nodes into a Wrapper document. AM I able to do this with the XML-Templater or do I need to use an additional transformer?Think of it like this.My Templater creates this:<parent> <child> <value> </child> <child> <value> </child></parent>But I need:<?xml version="1.0" encoding="utf-8"?><CABS_BPLAN_Records xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ikxBase="http://schemas.webs.idu.de/cardo3/Ikx/IkxBase" xsi:schemaLocation="http://www.cardogis.com/ikx/schema/HEIDEKREIS/Exchange puzzle.xsd" xmlns="http://www.cardogis.com/ikx/schema/HEIDEKRE
Hi,Does anybody have any experience in writing hyperlinks in an Autocad DWG?The only mention in the documentation is rather sketchy and doesnt help much :Shttp://docs.safe.com/fme/2015.1/html/FME_Desktop_D...Any tips or info are welcome.Itay
From this Q&A;: Geojson reader-encoding issueThe Source URL: http://stadtplan.bonn.de/geojson?Thema=14403&koordsys;=25832/geojson.jsonI think there is a room to improve GeoJSON handling.The GeoJSON reader should support various encodings.The GeoJSON reader and the GeometryReplacer (Geometry Encoding: GeoJSON) should set an appropriate coordinate system to the geometry if the "geometry" member object contains a valid "crs" member, like this.{ "type" : "FeatureCollection", "features" : [ { "type" : "Feature", "geometry" : { "type" : "Point", "crs" : { "type" : "name", "properties" : { "name" : "EPSG:25832" } }, "coordinates" : [ 369127.5691, 5624581.982 ] }, "properties" : {...
The URL for the reader is : https://itportal.decc.gov.uk/arcgis/services/OGA_Public_WGS84/OGA_Quadrants_WGS84/MapServer/WFSServer?request=GetCapabilities&service;=WFSThe XML for all the relevant URLs in the log file appear OK to me, and no errors are being reported (not even any warnings).
Hi all,I am using FeatureWriter to update an existing Feature Class that lives in my SDE. Versioning is enabled. The Transaction Type is a Versioned Edit Session and my Writer Mode is Insert. I have Drop Table as No and Truncate Table as Yes. Essentially I want to replace the old FC with the new one I am creating.I noticed the writing was taking a while, and it seems like it eventually times out. Maybe this is the case, I want to double check with the community.The full error message is:"An error occurred while attempting to store a row into the table 'SDE.XXXX'. The error number from ArcObjects is: '-2147154945'. The error message from ArcObjects is: {Table schema changes after cursor declared [42000:[Microsoft][SQL Server Native Client 11.0][SQL Server]Could not complete cursor operation because the table schema changed after the cursor was declared.] [DB.SDE.XXXX]}"To note: I am not touching anything while this process is running. Thanks!
Can anybody tell me how to do the following?I am trying to shoot video or take LOTS of pics and stitch together with my LiDAR point cloud....this way it is like Google Streetview but with cm measurable quality
Hello,I am trying to parse an HTML page with FME 2014 but, after a bunch of tests, I do not succeed in decoding the rather simple <table> section of my HTML imput. I fear that my troubles come from the FME version I am currently using.I have indeed read many posts dealing with HTMLExtractor, HTML Table Reader but these transformers are only available in 2017 version (thanks to @takashi for all of them !).Can someone tell me if there is a way to decode HTML table section with 2014 version of FME and how ? I join a sample of the file I have been trying to decode (the <table> part is the only interesting section of this file).Any help would be really appreciated.Thanks a lot.
I am using an eval version of FME Workbench 2016. Threw the following error message when I have more than 2 Esri Geodatabase (File Geodb API) readers in my workspace. Anybody had the same issue?FME API version of module 'FILEGDB' matches current internal version (3.8 20160224)Error running translation.
I have run a task to get an attribute data from kml tag and successfully get an attribute table in data inspector but unable to save data as an ESRI Shapefile because of 0 data transform as log below. why? Features Read Summary=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-XQueryExtractor_QUERY_RESULTS 445==============================================================================Total Features Read 445=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- FFS to ESRISHAPE Statistics=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Input Features Transformed=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-==================
Hello,I would like to do a migration between Reader ( Oracle - No Spatial ) to Writer ( SQL Server ).The question is: Its possible to migrate all from Oracle ( primary keys, foreign keys, indexes , views ) to SQL Server? Thanks,Danilo
My shapefiles have attributes coded as short (integer with 6 digits) and FME2016 read them as long, so when I output them in a dynamic workflow, their width is 10.- If I manually force to short, they are 5 digits long, which is not OK...- If I manually force to number with 6 digits and precision 0, it is OK, but I can't do it dynamically with datasets of many shapefiles... This is since FME2016 supports the short/long etc. datatypes for shapefiles. With FME2015, my data was understood correctly as number with 6 digits, in dynamic workflows.Is it a bug or can I automatically force all such attributes to numbers with 6 digits ?
I have problem with creation DEM/elevation raster from ASCII XYZ. I've loaded ASCII XYZ using CSV. I've used transformers: VertexCreator, NumericRasterizer. Translation was SUCCESSFUL, but finally elevation doesn't exist. What can be wrong? In attachment I send fmw file.
HiI have a simple workbench that converts ASC > XYZ as below:fme ASC_to_XYZ.fmw --SourceDataset NT26SW.asc --DestDataset NT26SW.xyzHow can I make the workbench deal with a dynamic "SourceDataset" as sometimes I need to pass a gzipped version of the sourcefile. The example below with the ".asc.gz" sourcefile will not work. fme ASC_to_XYZ.fmw --SourceDataset NT26SW.asc.gz --DestDataset NT26SW.xyz I am trying to resist re-writing code that pre extracts the "asc.gz" file before passing to FME.Thanks,Mike
Hi, I havethis error using FME FileCopyWriter (runs on FME Server) to copy files processedby FME to a fileshare that is monitored by Biztalk. Biztalk is taking care oftransferring files to a different (and isolated) location. We are currently testing a set of about 100 files(140Mb, mostly shapefile, jpg and wld), the final set would take about 4500files and 40Gb.I use aworkspace that reads from Excel a list of source and target locations, and a FeatureReader(PATH Reader) to read all files at the source location. Finally a File CopyWriter to write each file to the Biztalk target location.Sourcefiles are ready and static, no read/write actions on them. When running theworkspace with Biztalk services turned off things are all running fine.However, when Biztalk services are running, the process crashes with thefollowing error: 2017-08-08 09:33:07| 0.5| 0.0|INFORM|File Copy Writer: Copying file '2016_01w_O10_1_2.jpg'2017-08-08 09:33:07| 0.5| 0.0|ERROR |File Copy Writer: Error attemptin
I would like to be able to make a WFS- (HTTPCaller-)request within a variable bbox-area. These variable bbox-parameters represent municipality-areas. Currently my worfklow looks like this:In my current workflow I make a request to a WFS-service containing municpality names and boundaries (not included in the screenshot). Next I make use of BoundsExtractor and AttributeWriter to store these bbox-values.Next, I have a CSV-file containing all of my WFS-requests (FeatureReader3)For instance:ID,URL1;https://geoservices.informatievlaanderen.be/overdrachtdiensten/GRB/wfs?version=1.1.0&request;=GetFeature&maxFeatures;=1000&StartIndex;=1&typename;=GRB:GBG&outputformat;=application/jsonWhat I would like to do is to join URL from above (FeatureReader3) with the BBOX-values coming form FeatureReader4. Ultimately my request should look like:https://geoservices.informatievlaanderen.be/overdrachtdiensten/GRB/wfs?version=1.1.0&request;=GetFeature&maxFeatures;=1000&Start
Hi everybody,I have a .mdb emtpy fields. Now, I want to convert to .Gdb (point format).I use read .mdb and writer .gdb but I don't get point file in Gdb. Could you tell me why? Thank youI attached my workspace in the bellow:
I have a workspace that is aimed at accepting either a shapefile or a DWG to define an area of interest which in turn is used to find data. I've linked both readers to optional parameters, blank default sources, and set 'ignore failed readers' to yes, yet when only uploading a shapefile (i.e. not uploading a DWG) I still get a process failure on FME Server with this message about the DWG reader failing:I can try later with feature readers, but to me this shouldn't fail - any ideas?
Hi guys,I am trying to automate a process which requires to write into a new file-geodatabase everytime i run. is there a way that FME can create a new file geodatabase for my feature classes in a same workbench?Thanks!
I have a dataset with 3D buildings in the format CityGML (EPSG: 25832) and would like to present this in Cesium as 3DTiles. The 3DTiles must be available in the WGS84 with units in Radians, and at first the longitude and then the latitude must be listed. (See 3DTiles specification: https://github.com/AnalyticalGraphicsInc/3d-tiles#coordinate-system-and-units) Input data: Format: CityGML EPSG: 25832, Unit: metre Geodetic CRS: ETRS89 Date: European Terrestrial Reference System 1989 Ellipsoid: GRS 1980 Example: 544913.83 5460346.67 205.41 (x, y, z) Required output data: Format: 3DTiles EPSG: 4326 but in the unit radiant Geodetic CRS: WGS 84 Date: World Geodetic System 1984 Ellipsoid: WGS 84 Prime meridian: Greenwich Example: 0.1678606623,0.86034635,205.41 (longitude, latitude, height)Here my experiments:Reader: CityGML (EPSG 25832) -> Writer: 3DTiles (LL84-RADIANS)Reader: CityGML (EPSG 25832) -> CSMapReprojector (25832 to LL84-RADIANS) -> Writer: 3DTiles (LL84
Hello,I am curious to know if the Scheduled Instance on FME Cloud would terminate a non completed job in FME Server.In this theoretical scenario I would schedule the FME Cloud Instance to be activated let's say at 10 a.m every day and that the FME Server Job would run at 10:15 every day. Under normal circumstances it would take 30 minutes to run the job and my FME Cloud Instance will be deactivated at 11 a.m . But what would happen if the FME Server Scheduled Job one day takes 1h 30 m to run, would FME Cloud Scheduled Instance wait for the job to complete? Thank you.Lyes
I am using the Esri ArcGIS Portal Feature Service writer to publish feature services to our ArcGIS Portal from an Oracle database. When we use ArcMap to do this it writes to ArcGIS Server, not ArcGIS Portal, and creates a link between the Oracle database and the feature service in ArcGIS Server. Then when the data changes in Oracle, those changes are reflected in ArcGIS Server. You can also write back to the database by putting the feature service on a map in ArcGIS Portal.However, this is not the case with the FME Portal Feature Service. It creates a file geodatabase and a feature service from that geodatabase, but the link to the source Oracle database is broken. In ESRI terminology this is a "hosted service". Changes to the Oracle database are not pushed to the feature service.Are there plans to make a Esri service that writes to ArcGIS Server and keeps the connection between the source database and the feature service? We would like to automate our publish process to ArcG
Is there a way to reduce the bit depth in TIF images from 24 to 8? I've gad a look at the RasterInterpretationCoercer and RasterNandInterpretationCoercer transformers but haven't managed to get very far. The ultimate destination is BIX BCP and this is only compatible with 8 bit colour hence the requirement to reduce the bit depth. Thanks, Matt
Hi,I have received a text file to convert to polygons with donuts but I am unfamiliar with the format. Does anyone have any experience with a file with the following header:Version 780 Charset "WindowsLatin1" Delimiter "," CoordSys Earth Projection 20, 109, "m", 5.387638889, 52.156160556, 0.9999079, 155000, 463000 Bounds (13558, 306866) (278118, 619026) Columns 1 RxLev Char(9) Data Region 789 36733 278118 583666 278038 583666 278038 583746 278038 583825.9999 278038 583906 277958.0001 583906 277958.0001 583986 277878 583986 277798 583986 277718 583986 277638.0001 583986 277558 583986 277478 583986 277478 583906 277398 583906 277398 583986 277318.0001 583986 277238 583986 277158 583986 277158 584065.9999 277078 584065.9999The end of the file has the following information: 7 16518.0001 365666 16438 365666 16438 365585.9999 16438 365506 16518.0001 365506 16518.0001 365585.9999 16518.0001 365666 5 199958 461506 199878 461506 199878 461425.9999 19995