Using transformers to modify data.
Recently active
I'll start simple and add detail as necessary. I am working with the workspace runner. I have a table that I want to select unique values on and export as separate point feature classes (a simple iteration).I have four unique values on 200,000 ish records.I have set up a workspace runner and plugged it into a unique attribute logger that creates the four values I want to use to make feature classes.It is being so finnicky I don't know where to start. Usually, it will create the first feature class, but with not nearly enough records - and not make the other three. The log file usually will say a lock caused a crash.However, it works perfectly sometimes and I can't figure out why. At noon I thought I was in business, after a good run. By 5:00, I was stumped. I set 'wait for job to complete' to 'yes' and it seems like it made all four feature classes four times - way too many records and it took forever.Is there a way to control locking? I don't know why i
I need help with ideas on how to extract areas where the width >=1.1m within a polygon. I have attached a file (file geodatabase) here for anyone who wants to give it a shot. It is a long and skinny polygon reflecting sidewalks with curb and gutter all connected together in reality.I have a solution working okay for a small number of such polygons. But it is not working efficiently enough for a large number of records. I have a total of more than 20,000 records to be processed.Please share your thoughts.Thanks!
Hi. I want to transform data from Oracle spatial to PostGIS. There are over 100 classes to transform. That's why I go with the option "generate workspace". For the writer I choose a PostGIS connection. In the Parameters I have to click the option "lower case attributs name". The same I need for the table name. If the table name is in uppercase letter, I'm not able to open the PostGIS database anymore. If I manualy set it in lower case letter, it works. But there are over 100 writers. Is there a posiblitity to set that generaly? To choose the function "import feature tye" is no option. In this case there is a lower case table name, but reader and writer attributes doesn't finde eache other.
I have a SQL statement that contains a regexp_contains. It works fine in BigQuery SQL Editor, but FME chokes on it before it even executes it in BiqQuery. Even if I comment out the statement it still throws the same error unless I remove it completely.regexp_contains(table1.col1, '^[[:digit:]]+$')Do I have to escape this somehow? Error :Using Java Reader Interface Version 2.0 (Oct 31, 2000) with module GOOGLEBIGQUERY to read dataGoogle BigQuery: Using billing project xxxjava.lang.IllegalArgumentException: Illegal group reference
Hi,I am able to use iCloud as data provider in the FME AR app, but when I try to open the same file in Google Drive the file is greyed out.Does anyone else have the same problem? Read More ( vietnamese languae ) : thay pin iphone 11 and more sửa iPhone hcm
I am new for FME actually. I have FME case C657637 generated. but is any support to open the case? it is about dissolving line segments.
I want to filter out duplicate points from two point feature classes, however, every SpatialFilter configuration I have tried returns the duplicate points as failing all predicate test. Am I missing a configuration step?
Hello,Every time a run workbench I get this error near the end. Postgres doesn't print any errors in the logs. AttributeManager_2_OUTPUT Feature Counter -1 17 (TeeFactory): Cloned 60483 input feature(s) into 60483 output feature(s)Error executing SQL command ('COMMIT'): 'Error connecting to database'POSTGIS writer: A fatal error has occurred. Check the logfile above for detailsFeatureWriter_2 (WriterFactory): POSTGIS writer: A fatal error has occurred. Check the logfile above for details Any idea of what is going wrong?
I have very little python knowledge so I have real trouble understanding the documentation FME provides:http://docs.safe.com/fme/html/fmepython/api/fmeobjects/_rastertools/fmeobjects.FMERasterTools.calculateSlope.html?highlight=rastertools#fmeobjects.FMERasterTools.calculateSlope I have a PythonCaller that calculates the slope of a Raster. At the end I want to itterate over the cells to calculate the desired height, but for now I want to understand how to use Python to manipulate a raster. class FeatureProcessor(object): def input(self,feature): raster = feature.getGeometry() rst = fmeobjects.FMERasterTools() settings = {'kFME_CalculateSlope_interpolateNodata' : 'No'} raster_new = rst.calculateSlope(1,raster,settings) feature.setGeometry(raster_new)This works, except that it still interpolates Nodata. So how should I write down the settings dict to tell the function not to interpolate and use the Horn method?
I am trying to do a translation of multiple pdf files (11 in this case), and I want them as jpg files, as simple pictures. My attemp was to import all the folder that contains the pdfs, and to pass them through a dynamic jpg writer, but I am getting an error from the jpg writer that says that "This format cannot support more than 3 bands". I dont know if I am configuring something wrong in the writer, please give me an advice. Thank you
I have a dirty stormwater network for a large region, which contains many network loops/cycles and non-directional features. The network is made up of Stormwater PipesStomrwater ConnectionsStormwater Channels/WatercoursesRivers/Large StreamsI would like to estimate the primary flow through the network with the following assumptionsFlow direction will be down hillAt network junctions, flow direction will be prioritized by edge typeRiversWatercourses/ChannelsPipesLarger PipesSmaller PipesI have made some progress using the Network Flow Orientor and Stream Priority Calculator (Im setting flow direction by finding the sink/source with the lowest elevation per network group). Prior to the Stream Priority Tool, I am assigning weights to edge features based on edge type, and using this as the forward and reverse weight. This method seems to prioritize streams and channels over pipes, however I'm not sure how I can prioritize larger pipes over smaller pipes. I have tried sorting pipes o
Hello everybody, I have a layer of points and I wanted to calculate the azimuth of each point, suddenly I thought to make a pythoncaller to call the API of QGis in order to use the Azimuth function, I'm a little stuck on this integration if you have any proposal, I will be recognizable.
Hi Everyone I have been trying to read pdfs and save to jpeg. The issue seems that I can only write 3 Bands to the Jpeg Writer(R,G,B). Once I remove the Alpha8 Channel, the background turns black. I have tried multiple ways of fixing it, but to no avail, I am stuck right now. I found this excellent Article on the forum, but I still seem to have the issue with the Colour Values, can someone please help out? Is there an elegant way of fixing this? I can succesfully export png, but can't crack this Jpeg Writer! Any help or advice will greatly appreciated. Fred
Hi. I'm trying to read a pdf of a 2D CAD drawing. The file opens ok in Microsoft Edge browser but when I use the Adobe Geospatial PDF reader it is only reading a fraction of the elements in the file - a few text elements. I've tried playing around with the reader parameters but cant figure out why its not reading the whole file. Any idea what i'm doing wrong?
I'm reading archived tables with the GEODATABASE_SDE format, i.e. with connection file. I'm trying to access the special archive views for this occassion. The ones that SDE creates automatically which has the "_EVW" postfix. Though I cant see them in the list of available geometry tables. I'm connecting as the schema owner with a FeatureReader. How does this work? Does FME figure that out automatically? For example if I read features from table "SAMPLES", the question actually directs to SAMPLES_EVW view? Or does it work any other way. I did some tests and created a logger which helped me out with the number of features read. For one of the tables I got the logger saying that it "Cloned 841467 input feature(s)" When counting the records in the database I got the numbers:Table: 840 225EVW-view: 840 227 Three different numbers is what made me write this question. So how does this actually work?
Hi. I am using GeometryValidator for some buildings as multisolids. All of them has been created together, but after the GeometryValidator, some of them come out from Failed part. I need all the 3D buildings. Can I repair them before the GeometryValidator?I set the set of issues to Detect to Surfaces and Solids. Thanks
I have saved MVT tiles locally like this, c:/3006/0(zoom level)/0(Tilecol)/0(Tilerow).mvtInformation about the tileset below.<TileMatrixSetLink><TileMatrixSet>3006</TileMatrixSet></TileMatrixSetLink> <TileMatrix><ows:Identifier>10</ows:Identifier><ScaleDenominator>14285.71428571428623399697</ScaleDenominator><TopLeftCorner>8500000.000000 -1200000.000000</TopLeftCorner><TileWidth>256</TileWidth><TileHeight>256</TileHeight><MatrixWidth>4096</MatrixWidth><MatrixHeight>4096</MatrixHeight> When I RUN the Workspace I get this translation log (see link) and no GeoJSON file is to be seen. What do I do wrong? https://docs.google.com/document/d/1u-BgtK6lU4SUKFFPjG-lv4Gs2VYHLc7AIOXo-Is_QB8/edit?usp=sharing
Hello,I am trying to POST an XML using the HTTP Caller, but get a 415 error.I have an API tool for the application that I am trying interact with, and manage to POST the XML with success.I have seen other posts that suggest it is the header of the XML / Content Type option which is incorrect, but I have tried all the options I can think of. Any help would be appreciated. I have pasted the XML I am using below, and attached the test workbench I'm using. Note that I have deleted credentials / sensitive information.Cheers<?xml version="1.0" encoding="utf-8" standalone="yes"?><Mail> <TotalAttachmentCount>0</TotalAttachmentCount> <Confidential>false</Confidential> <RichMailText>false</RichMailText> <MailSubject>TEST2</MailSubject> <ToUserId>1476934057</ToUserId> <MailTypeId>2154</MailTypeId> <MailFormFields> <MailFormField identifier="DesignPackage_singleSelect">N/A - Not Applicable</MailFor
Hi Folks,we are trying to save json request/response data into oracle database using SQLExecutor and getting following error java.sql.SQLSyntaxErrorException: ORA-01704: string literal too long Request that we are trying to save is more than 6000 characters. Appreciate your suggestions ?
I have the problem that the characters >< that I have inserted in the AttributeCreator are converted to &gt; and &lt; in the XML Templater.
I have a coordinate system definition from a ESRI shape *.prj -file.It seems to be EPSG:3411, even if there are small differences in the definition. How can I create a costum coordinate system to use on both FME desktop and server?The tool her https://demos-safe-software.fmecloud.com/fmedatastreaming/Coordsys/Start.fmw does not work. I would appreciate any help with this:https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Workbench/Workbench/coordinate_sys_custom_about.htm Thanks. Here are the definitions: *.prj-filePROJCS["NSIDC_Sea_Ice_Polar_Stereographic_North",GEOGCS["GCS_Unspecified datum based upon the Hughes 1980 ellipsoid",DATUM["D_Hughes_1980",SPHEROID["Hughes_1980",6378273,298.279411123064]],PRIMEM["Greenwich",0],UNIT["Degree",0.017453292519943295]],PROJECTION["Stereographic_North_Pole"],PARAMETER["standard_parallel_1",70],PARAMETER["central_meridian",-45],PARAMETER["false_
We are migrating data from Smallworld Electric Office 5.x data into ESRI Enterprise Geodatabase(SDE), while doing the process we came across one difficulty to export the data for the table named "Cable Existing Phase" which stores the relationship between main tables and unit tables in Smallworld native environment.We used the below parameters for the Smallworld readerReader: Smallworld 4/5Service: FMEExpose Internal Tables: On Please refer to the screenshot of the tables which we are getting after using the "Expose Internal Tables" as ON. Here we are missing a table called "eo_cable_exi_phase". Without the "Cable Existing Phase" table in the target environment, we can't build the relationships between feature classes. Is there any alternative approach or any other plugin (SBS) to resolve the issue
Hi all,I have a set up FBX mesh tiles in one coordinate system (GDA94 MGA56) and need to reproject to another (BCSG02). When I try do that in FME, my 3D meshes get flattened to 2D images. What am I missing here? I am using the out of the box FBX reader & writer, and a reprojector transformer? Thank you!
I am having trouble understanding the documentation for the JSONUpdater tool. I've put together a simple workspace (attached) that demonstrates my partial success. I want to create a GeoJSON file from a shapefile. I can successfully do this with FeatureWriter. So far so good. See screenshots 1. and 2. below. Now I want to add a key-value pair to the root of the JSON object that would identify the edition of the collection -- as shown in screenshot 3. So I include the JSONUpdater transformer. as pictured in Screenshot 4. below. I've tried a lot of options in this transformer but nothing I do has any effect on the json file. Can someone give me a hint? Screenshot 1: Workbench diagram Screenshot 2: FeatureWriter ParametersScreenshot 3: Geojson I get. Screenshot 4: GeoJSON I want.Screenshot 5: JSON Updater Parameters.
After we upgraded to v1.0.0 we starting getting a ton of datatype errors.The Athena Query was working fine and writing results but the connector was choking on such things as decimal to int casts, and some random strange errors on cols we have never had issues with before. I started to resolve some of them by switching to bigint, but then another one in the stream would fail. Ugh. We have close to 75 Athena Mappings, so we reverted back to the previous version. Solved everything. If we had not, we would have to modify things like casts and decipher some other strange errors on many of those 75 mappngs. Anyone else having issues with v1.0.0?