Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Groups
Support
Knowledge

EN

Home
Search

Best Answers

10389 Posts

Recently active

Most views Most replies

asked in Transformers

Optimising use of RasterCellCoercer

Hi All, I've been tasked with optimising a workbench that's quite slow. Basically I take in a very large DEM raster 2m granularity, and need to clip it against a vector dataset of 50m grid squares. The vector dataset then pulls the underlying raster data (RasterCellCoercer), and calculates statistics (StatisticsCalculator) using a group-by from the clipping. The clipping part I've got down to about 30minutes. The problem is the RasterCellCoercer. That part takes 15hrs! It creates about 300,000,000 points (yes, 300 million!) from the raster (there are about 4.5 Billion points in the source raster, so the other 4.2billion are no "noData" or were culled completely). I can't think of a way to get the number lower because that's how many the features require. Any suggestions for a faster way to get the DEM values in a way that they can be grouped for a statisticsCalculator pass? Would somehow trying to coerce it into a Poi

asked in General

What does "OUTPUT does not recognize tag 'REJECTED'" mean in FME Server?

I have a workspace with a custom transformer that contains GeometryValidator transformer. The transformer should check fme_geometry for basic geometry checks. The workspace works fine in FME Desktop when is run locally. When the workspace is loaded onto FME Server I get the above error message in the logger. Before hitting that transformer the native coordinates of the feature are converted from WKT (the format which enters the workspace) before that transformer (the GeometryValidator) I have also other checks that prevent the process to proceed if the WKT is empty or the area is smaller than a certain threshold, for some reasons when I test it with smaller areas or empty strings the transformer is called and produces the above error. Also, I tried to disable the GeometryValidator transformer but I still get that error, when the data does not even pass by that transformer. If I remove the transformer from the workspace and I upload it to server then everything works fine but I would ne

asked in Transformers

Unable to Validate XML using XML Validator, namespace problem?

Hi Im having trouble validating some XML, I keep getting no declaration found for element Features errors.heres the 1st part of the XSD <?xml version="1.0" ?><xs:schema id="Features" targetNamespace="urn:284_SeAr.xsd" xmlns="urn:284_SeAr.xsd" xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:sql="urn:schemas-microsoft-com:mapping-schema" xmlns:dt="urn:schemas-microsoft-com:datatypes" attributeFormDefault="qualified" elementFormDefault="qualified"> <xs:element name="Sediment_Area"> <xs:complexType> <xs:sequence>...And heres the start of my XML<?xml version="1.0" encoding="UTF-8"?><Features> <Sediment_Area>it complains no declaration found for element 'Features'But even if I remove the features element it still has similar errors all over the rest of it. After looking at some similar problems I am now suspecting this is something to do with the namespaces but even if I move them into my XML it doesn't seem to parse.Is features actua

asked in Transformers

Filter duplicates looking in two fields

Hi,I would like to filter out whether a certain value appears multiple times in either of two fields. An example:ID1ID2Desired action1_22_1keep1_33_1keep2_11_2discardCurrent attempts have either given me the rows which don't ever appear twice across the two fields, or a full list of those that do appear twice across the two fields. Is there a way to filter out duplicates looking at both fields?

Clean up csv data

I have a csv separated by semicolon. Some lines have too many semicolons (bad data). To clean up the data I have read the csv with a Text File Reader to read line-by-line and used an AttributeCreator to create an attribute for the number of semicolons in each line. Then I followed that up with a Tester to retrieve the lines with the correct number of semicolons (clean data). Now I have this text line data and need to write back to a csv. I cannot figure out how to write to a csv from the text line data.

joshuadamronContributor

Copying a writer feature type creates a file name alias (Esri/ArcGIS)

Howdy,This question pertains to working with file name/feature class name & name alias for shape files & file geodatabase feature classes.My Question is: Where in FME can I modify the Name alias when writing to a shape file or file geodatabase feature class? I am not seeing this in the parameters or the Format Attributes.Note: This is not a question about a geodatabase field name alias, help on that can be found here: https://knowledge.safe.com/content/kbentry/22423/working-with-geodatabase-field-aliases.htmlHow this became an issue for me:Working with FME 2018.1 I noticed that when working in a workbench I noticed that an issue pops up when I get lazy and instead of adding a new writer feature type I do a quick copy and paste to create a new writer feature type that I then rename (Parameters > General > Feature Class or Table Name). When that pasted/renamed feature class is output the name from the parent/copied writer feature type is written to the name alias.An exa

asked in Authoring

Rounding the elements of a list

Hello, I have a list of numbers and I wanna round all its elements to a precision. How it can be done in FME ? Thank you very much in advance.

boubcherContributor

asked in Transformers

Failed to obtain any schemas from reader 'WFS'

Hello There I am traying to read this bellow wfs , I trayed all combination on configuring the wfs reader but still giving me the error ( Failed to obtain any schemas from reader 'WFS' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information)twe could open the URL on browser and also we could read it on ArcMAPhttp://webgis.eamana.gov.sa/arcgisnew/services/BASEMAP/MapServer/WFSServer?request=GetCapabilities&service;=WFS

gioContributor

oracle julian dates

Hi all,This works in SQL Developer.Why does this not work in a SQL Executor/Creator?select to_date(736845 + to_char(to_date ('02-01-0001'),'J'),'J') t1,to_char(to_date ('02-01-0001'),'J') t0from dualoutput:T1 T031-05-18 1721425Fme executor insists `ORA-01843: not a valid month'which is totaly not true! It appears that the 'J', julian format is not recognised. Is this a error or am i missing something?Don't suggest out of sql solutions, i wan't it to be done in the executor. Be aware i will issue demerits !! ;) SQL answers required. Greets an txia for your answers.

asked in Transformers

Deconstructing polygons

Hello,I have polygons that are constructed from lines using line closer and area builder so i could add some attributes from other features. Now i need to deconstuct back to lines with those attributes. Unfortunately i had no luck searching the forum for related issues. Any help?

jeroenContributor

asked in Transformers

GML geometry to WKT geometry

I have an attribute that contains GML geometry that I would like to convert to WKT geometry but its not going so well. For the easy geometry in these files a simple GeometryReplacer does the trick and with a simple stringsplit action in python this is also converted without using too much resources. <?xml version="1.0" encoding="UTF-16"?><stufgeo:kruinlijnBegroeidTerreindeel xmlns:stufgeo="http://www.geostandaarden.nl/imgeo/2.1/stuf-imgeo/1.3"> <gml:Curve srsName="EPSG:28992" xmlns:gml="http://www.opengis.net/gml"> <gml:segments> <gml:LineStringSegment> <gml:posList srsDimension="2">161274.467 453784.372 161277.253 453785.924 161279.958 453787.131 161280.921 453787.508</gml:posList> </gml:LineStringSegment> </gml:segments> </gml:Curve> </stufgeo:kruinlijnBegroeidTerreindeel>Using stringsplit or Python the result would look like this:LINESTRING(161274.467 453784.372,161277.253 453785.924,16

asked in Authoring

writing table with featurereader / featurewriter produces inconsistent results in FME 2018

I am using a FeatureReader to read a data source (e.g. SHP file) and then immediately writing it to postGIS using a FeatureWriter. Because the input is supposed to be agnostic as to the exact data being uploaded, I am using the "single output port" option and outputting the results via the Generic port, which is being directly fed into the FeatureReader.In FME 2017 this worked. In 2018 I am having a problem - the writer only works correctly if the destination table already exists (i.e. with the "Use Existing" option).If I use the "Drop and Create" option in the writer, all I get is the geometry column in the destination table. The other columns don't come across.I saw a forum post where a user was advised to use a dynamic writer and to pass the schema in like this:https://knowledge.safe.com/questions/46483/generic-attribute-from-featurereader.htmlThis works, but has one major annoyance - I lose control of the name of the output table - I have to use th

jeroenContributor

asked in Authoring

Use files created by FME server Jobsubmitter in the same flow for data download

I'm working on a workflows that will run on my FME Cloud and is started by a REST command. The idea is to develop a database driven pdf creator that generates x amount of pdf pages and bundles them a zip. The setup of my workflow is as follow(or should at least work like this):Step 1: Rest command is send to the cloud with a TaskID and starts the workflow 1.Step 2: Workflow 1 will get the information in our database that is connected to the TaskID. The table that is fetched contains an x amount of PageID's (depending on how many pages is needed) and each PageID contains the information that is needed to set the paper size, geom layers, WMS stuff, graphs and tables, name of the PDF and other information that is needed.Step 3: For each PageID athere is one line submitted to the FMEServerjobsubmitter (in sequence and waits for job to complete) with the information that is needed to start workflow 2 that builds the pdf out of the table that is generated in step 2. For each PagaID a

asked in Integration

Python FME API Documentation: Code example for raster creation could be wrong

I'm afraid that this code in the "Getting Started Working with rasters" section is wrong. # creating the new FMERaster rasterProperties = fmeobjects.FMERasterProperties(numRows, numCols, xCellOrigin, yCellOrigin, xSpacing, ySpacing, xOrigin, yOrigin, xRotation, yRotation)According to the API reference, the order of parameters should be: # creating the new FMERaster rasterProperties = fmeobjects.FMERasterProperties(numRows, numCols, xSpacing, ySpacing, xCellOrigin, yCellOrigin, xOrigin, yOrigin, xRotation, yRo

asked in Integration

FTPCaller VS SystemCaller for FTP Calls

Hello All, I am posting this question to try to gain an in-depth understanding of the functionality of FTPCaller vs SystemCaller.I designed a script that used SystemCaller to call on CoreFTP in order to upload and overwrite a file to a certain site and log the results in a text document. This is the SystemCaller command: ""C:\\Program Files\\CoreFTP\\Coreftp.exe" -O -u @Value(file_path) @Value(site_command) -log "@Value(routinglogdirectory)@Value(_rootname).log"The command worked successfully. It took 12 seconds to run. I switched to an FTPCaller to run the same function. The time was reduced to 1 second.Just for my understanding, I am wondering what is FTPCaller doing differently in the background? Would love to hear some insights from FME. Thanks, Fariya

boubcherContributor

Export GeoDB to Excel

Hello I am Looking to export the Geodatabase schema ( manay tables) without the data to an excel sheetcolumn 1: table nameColumn2: attribute nameColumn 3: attribute typeColumn 4:width

asked in Transformers

Create continuous line builder output with connection break attributes

I'm creating a collection of line features from a GPX file. I've processed the points from the file to calculate things like slope and speed at the various locations. I've then generalized these slope attributes into Uphill, Downhill, and Flat. I want to use these as Connection Break Attributes to segment the LineBuilder output. However, upon doing this I've realized that there are distinct gaps in the track as there is no line connection between the vertices that start/end a line that has a different Connection Break Attribute. Is there a tidy way to attach these together?

asked in Transformers

Creating point from national grid code

HiI have a set of CSV files from http://nrfa.ceh.ac.uk which specify a national grid reference for the location of gauging stations - e.g. TQ0993167056 for "Thames at Walton" (station ID 39121).I'm trying to read in the text files and create points from the grid references so that I can do spatial transformations, but can't seem to get FME to create geometry objects from the codes. If I had lat and long I would use the vertexcreator but can't seem to find an equivalent that works with BNGAny help would be much appreciatedThanksAdam

asked in Transformers

Control FME Desktop memory usage

I am running a Workspace and after a while it gives an error and as if the memory had burst, is there any way to control memory?

lifalin2016Supporter

asked in Authoring

"Dynamic" output to SQL Server - no Table Qualifier/database schema ?

Hi,I'm fairly new to using the dynamic output, but needed it for converting a set of shape files to SQL Server.The writer has a "Table Qualifier" field, which in static writing designates the target database schema.However, when used in dynamic writing mode, the value entered here is completely ignored, and the tables are all created in the "dbo" schema.Is this WAD og a bug ? And if WAD, is it possible to set the database schema anyway ?CheersLars I.

asked in Authoring

Help with a Python script on a list

Hello, I have a list called ''list'' of variable length depending on features. I wanna assign as an attribute to each feature ''list(0) ; list(1) .... list(lenght(list))'' I tried writing a loop on the attribute manager but I didn't know how to use it well Thanks for any possible help :)

asked in Transformers

Convert datetime to string?

Hey,If I have a datetime, I'm wondering how I could convert it to a string.

ajbaum77Contributor

asked in Transformers

CSS Selcetors in HTML Extractor

Hi all,Working to parse some sections out of a webpage. I need to associate some values with their heading. I can get the h3 values I need or all the ul or li elements on the page but trying to get just the ul and li element under each h3 to keep them grouped. Seems like using a h3 ul li selector should work but it doesn't return anything. Changing the space to a comma (,) returns all the values not just those ul and li within the h3. I've also gotten the values for the h3 and can get each h3 individually using "h3:nth-of-type(@Value(part_idGEN))" but again trying to get the ul or li element under this doesn't work either.Using FME2018.0.0.1 Build 18295Webpage is https://www.thewindpower.net/windfarm_en_182_gent-zeehaven.php Thanks,Andrew

CityGML: change gml_geometry

Hello everybody,I'm using this template https://hub.safe.com/templates/citygml-create-solitaryvegetationobject-with-implicit-representation to create a CityGML file that contains trees as SolitaryVegetationObjects with implicit representation. The template works fine but doesn’t serve my purpose as I want to use the data in the 3DCityDB which doesn't support MultiGeometry features. Is there a way to change the gml_geometry?Thank you for your help.

philippebEnthusiast

asked in Transformers

Do you know what's the difference between RGB24 and RGB48? I know a byte is added to the pixel, but what's the real impact on the image?

1
...
284
285
286
287
288
289
290
...
416

Page 287 / 416

Badge Winners

nia.colebrookehas earned the badge Teacher (Bronze)
skuleprammhas earned the badge FME Form Basic Training
gimmy15+has earned the badge FME Certified Trainer
keziaatsafehas earned the badge Welcome Back
marionvdschaarhas earned the badge Welcome Back

Show all badges

Community Stats

31,819: Posts
120,860: Replies
39,451: Members

Latest FME

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.