Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,719 Replies
10000 Posts
buttonsmc
Participant
buttonsmcParticipant
asked in Transformers
Has anyone experienced these errors? symbols being replaced by text backslash Python Exception <FileNotFoundError>: [Errno 2] No such file or directory: ''

Happening in Parent just before Workspace RunnerExcerpt from log:WorkspaceRunner_2: Running FME Workspace E:\\supply\\Standard_Supply\\SQL_Server\\10km_Buffer_to_SQL_Supply/SQL_Server_County_10K_Buffer_Supply.fmw with command line:2023-07-25 16:30:02|  1.0| 0.0|INFORM|WorkspaceRunner_2: {C:/Program Files/FME2021/fme} E:/servername/Standard_Supply/SQL_Server/10km_Buffer_to_SQL__Supply/SQL_Server_County_10K_Buffer_Supply.fmw --INPUT_POLYGON E:<backslash>supply<backslash>Common_Dependencies<backslash>Esri_Shapefile<backslash>10k_Buffer_Local_Authorities<backslash>COUNTY.shp --QUARTER 2023Q3 --OUTPUT_COORD_SYS IRELAND-ITM --SQL_SERVER_BACKUP {\\<backslash><backslash>servername<backslash>e<dollar><backslash>SQLData<backslash>CountyCouncil<backslash>ITM<backslash>2023_Q3<backslash>COUNTY<backslash>2023Q3_COUNTY_ITM.bak} 16:30:05|  1.0| 0.0|WARN |WorkspaceRunner_2: Failed to run workspace E:/supply/Stand

300
kailinatsafe
Safer
jaygrg111_
Contributor
jaygrg111_Contributor
asked in Transformers
Parameters changes in HTTP Caller for Cityworks- windows authentication ?

I am trying to change the authentication from local to windows authentication in Cityworks. What changes do I need in HTTP Caller parameters? Is the chosing NTLM (username, password) under "Authentication" section enough or do I need to add something under "Header" or other parameters?

320
jaygrg111_
Contributor
vlroyrenn
Enthusiast
vlroyrennEnthusiast
asked in Transformers
Getting the attribute type metadata of incoming features

I'm trying to make a dynamic transformer that uses a feature writer to create a temporary file in some format (FFS, CSV, Parquet, doesn't matter) and I need to supply a schema line for the Feature Writer to accept the incoming features. Most readers won't supply one such line, and even though FME is keeps track of some sort of attribute type tag that AttributeMapper is now able to modify, and that AttributeValidator can check with the TYPE operator, there seems to be no way to either get the attribute type map from the features themselves (as shown when hovering the headers of the data inspector columns) or to get the attribute list from the feature type definition (as shown when inspecting a reader and checking the FEATURE_TYPE section of an FMW file). The only ways to get a schema line seem to be to use a SchemaScanner, a SchemaMapper, an AttributePivoter or a FeatureReader. SchemaScanner seems to be the reccomended option in a case like mine, although that does seem to r

1084
vlroyrenn
Enthusiast
S
siriosus
asked in Transformers
Calculate the time spend inside area (Time-aware geofencing)

Hello friendly FME Community! I'm trying to implement a GeoFencing service which will calculate the time spent by vehicles in particular areas. In short, I have a set of points (with timestamps) and set of polygons (geofences) against which I want to calculate how long these points were inside these polygons.  I did make a workspace which does this using SpatialFilter (which identifies if points were inside polygons) StatisticsCalculator which calculates min and max timestamps and DateTimeCalculator which calculates the interval between this min and max timestamps. The problem is that vehicle can move out of all polygons and then get back which will distort the calculation as the period that vehicle was outside the polygon will be included because last timestamp will be inside the polygon. Is there any trick or technique in FME which allows to follow up these gaps and exclude them from calculation described above? Thank you in advance for any suggestions!

560
adam.gwent
Participant
N
nic_pickers
asked in Transformers
Extracting x, y, z values of lines and polylines within a AutoCAD .dwg file

I have a few AutoCAD drawing files (.dwg) that have a number of 2D and 3D lines and polylines. My goal is to extract all the vertices of each individual line so that I can store it within my GIS database (PostgreSQL). Additionally, I want to extract the layer name and a few other attributes.  Is there a way to extract this data and convert it into a Shape file (.shp) ?  Cheers

5860
katitahonen
n.d
Contributor
n.dContributor
asked in Transformers
Reprojector

Hi. I aim to reproject the coordinate system EPSG:25832 to a metric coordinate system. Which destination system do you recommend?

340
redgeographics
Celebrity
R
redamrini
asked in Transformers
Points Cloud (LAS) to Cesium 3d tiles

Hi everyoneI wanted to know if there is any workflow I can do to convert my points cloud to Cesium 3D tiles and I wanted to be also georeferenced ?

1360
featuremichael
Enthusiast
larue
Contributor
larueContributor
asked in Transformers
How would you join collinear lines that have gaps within specific ranges?

Hello, I asked the above question in the New To FME forum, but no takers. Lets see what happens here. My goal is to join CAD wall lines that are collinear and have a gap where the door is located (usually 36"). The LineBuilder does not have a conditional option.  Two ways I can think of pursuing are:Group collinear lines that have a gap of 36" between end-point of one line and start-point of another. Lines have all been changed to a positive vector, so end-points are followed by start-points on X or Y axis.Use the CAD Door layer to locate prospective lines. These door symbols are blocks with an insertion point at the hinge. Very standard. Here is a screenshot, attached, of a typical hallway. There are large gaps which should be ignored and others that are approx. 36". On the left, you see two door setbacks. It is not a problem to separate horiz and vert lines if needed. Any help is appreciated. Thanks,@larue

2530
katitahonen
smithgk
Contributor
smithgkContributor
asked in Transformers
Defining columns in online text documents

Hello FME Experts that are far smarter than me, I have a very interesting text file that I need to isolate columns for to map points via lat and long values. Below is the URL to the dataset, it relates to fire weather conditions that are updated daily. https://www.wfas.net/images/firedanger/fdr_obs.txt I need to isolate the Colorado-related records and put all the values into their designated columns. If I use the standard text file reader, everything is mashed into one column (see screenshot). I tried using the CAT Reader, but can't seem to get that option to the right place. Does anyone know a better Reader or combination of Transformers that could help delineate these columns of data? 

827
geomancer
Evangelist
wasim13
Participant
wasim13Participant
asked in Transformers
How to write extended data in KML output as kml_data instead of kml_schema_data.

KML output written in kml_schema_data,I am not able to write in kml_data as shown in expected ouput image    

400
debbiatsafe
Safer
eqwansyafiq
Participant
eqwansyafiqParticipant
asked in Transformers
Using the Matcher transformer, is it possible for me to produce results from matched output and choose which row of attribute to merge and keep the attribute?

I attach a visual example, from the visual preview, I want the blue tick row to merge/duplicate the attribute while the row with the yellow mark to keep the attribute value from the original value. Any help or guide will be appreciated. Thank you.

110
hkingsbury
Celebrity
X
xukaitap
asked in Transformers
When I convert DWG files to SHP files, there is always a prefix "Q_" automatically added to the attributes in the Writer. How can I remove this prefix?

440
kailinatsafe
Safer
gogopotter90
Contributor
gogopotter90Contributor
asked in Transformers
How to change the coordinates geospatial pdf to coordinates of shape file

Hi , I have geospatial pdf has coordinates and I have shape file with other coordinates . i have read the pdf file with reader geospatial pdf and i can see that it has many layers and some data at pdf does not exist in my shape file and some exist  i would like to change coordinates of geospatial pdf to same coordinates as shape file .How could I achieve that ? the shape file consists of lines and polygons (Buildings) and points some of buildings and lines ,i can find also at pdf file but in other coordinates .it locates far away of each other . i have used pdf reader ,parameters coordinate page point and enable non spatial read meta data objects ,Map frames The type coordinates of geospatial pdf is unknown for me .which transformers could be useful to move geo pdf to same location of coordinates as shape file ? i am thinking if there is any transformer to compare between shapes and find which polygon is exact as other then provide shape coordinates to pdf file fme 2021

940
kailinatsafe
Safer
K
kokilam
asked in Transformers
split line feature where the point exist

Hi Team, I have a electric lines and electric devices . I want to split the lines where the device exist . I used the point on line overlayer with 0.001 tolerance . But its creating many new lines with 0.001 feet (less than a feet) lines .Ideally this shouldn't be . Its creating the issues when building the Utility network . can you please help me on this ?  

100
geomancer
Evangelist
S
samruddhee16
asked in Transformers
Getting an error here (as in the attached image) while trying to open and read S-101 file (.000) in FME Workbench. Anyone who faced a similar problem?

Not sure if, while renewing, the new license overwrites the older one or do we do it manually?If the license is ok, is there a mistake in how I am using workbench?The license we have is a temporarily renewed free trial license. The error message in the image shows that. Please advice on the same.

220
S
keithhastings
Contributor
keithhastingsContributor
asked in Transformers
Importing choice user parameter list without it sorting

Hi all, I have created a Choice user parameter and am importing the contents of the choice list (or dropdown) from a spreadsheet.The Import appears to decide itself how it wants to sort the contents of the list. Is there a way this sort can be turned off?I have already sorted the contents of the spreadsheet into the order I want, but the import kind of ruins this order, and then I am forced to manually reorder with the up and down arrows. This isn't too bad with a very small list, but is pretty frustrating with a much larger list (which I have). Plus I know I am going to have to refresh the contents of this list semi-regularly in the future.Does anyone know of a way around this? thankskeith 

440
keithhastings
Contributor
williamlin98
Contributor
williamlin98Contributor
asked in Transformers
Why doesn't my regex expression work?

I am trying to extract the 1st and 4th word but it just keeps grabbing the first 4 words, I've tried without the ^ and it doesn't work

290
williamlin98
Contributor
kristen
Contributor
kristenContributor
asked in Transformers
Iterating through a SDE, adding a field, moving existing values, and then dropping original values.

I have situation wherein I need to add fields to all the feature classes within a SDE. I cannot seem to figure out how to loop through the SDE, and operate on one feature class at a time, though. My first thought was to generate a list of all the feature classes in the SDE using two FeatureReaders, but then I was not sure how I would iterate through that list.  Any assistance would be greatly appreciated. Thanks!

90
ctredinnick
Supporter
L
lbd-kufers
asked in Transformers
Prevent the FeatureReader from trying to create a point geometry for Excel features

So apparently, FME does look for fields that might be a good candidate for creating a point geometry in both Excel and CSV readers (see https://community.safe.com/s/question/0D54Q000080hfENSAY/excel-format-of-attribute). This means that if in an Excel or CSV file, there is a row with column names such as X and Y, FME will automatically try to create a point with the contents of these cells. In the top-rated answer of the above link, it is mentioned that for the CSV reader, this will only occur if the option "Scan for types" is activated. This option does seem to be missing for the Excel reader, though, or am I overlooking something? I have the problem that I am using a FeatureReader to dynamically read from an Excel file (the specific file is only known at translation time, not before) and FME unwantedly tries to create point geometries for the features. The sheet of the Excel file might contain X and Y columns, but these are usually empty and surely not any spatial data. Nev

1330
jovitaatsafe
Safer
arthur_bazin
Contributor
arthur_bazinContributor
asked in Transformers
FME 2022 prepare statement in SQL Executor.

This is not a real question, it's more an assesment. In FME 2022, it seams that every query run with SQL Executor/Creator is run as a prepared statement (see here for more information on PostgreSQL https://www.postgresql.org/docs/current/sql-prepare.html). The problem is that only certain query can be prepared, not every one...Some of my queries can not work anymore like every "CREATE" queries that can not be prepared into PostgreSQL. Is there a way to disable this behaviour ?  For me it's a critical problem because some times we need the queries to be run as we write them, not like the database want to redefine them.

2677
arthur_bazin
Contributor
C
choppib
asked in Transformers
How do I force a device to release a floating licence?

We have one floating licence and it is now stuck on an old laptop and won't release it. Can I force it to release either from the device or from the licence server?

5980
gis_midwest
Contributor
ebygomm
Influencer
ebygommInfluencer
asked in Transformers
Cannot write string value of NULL to Postgres column with not null constraint if Bulk Insert set to Yes - Known Issue?

With a postgres writer it appears that if Bulk Insert is set to Yes, if you attempt to write a string value of NULL to a varchar column that has a Not Null constraint it is interpreted as a genuine null and results in a fatal errorError was 'ERROR:  null value in column "value" violates not-null constraintIf Bulk Insert is set to No, the value is written as a string as expected Is this a known issue? This is in FME(R) 2021.2.6.0 (20220727 - Build 21821) so may have already been addressed.

1590
jovitaatsafe
Safer
takanaka
Contributor
takanakaContributor
asked in Transformers
Clipper stuck without error (data+workspace included)

Hi, I'm running into an issue that I don't understand the solution to.Using the geometries attached here, I can not clip the geometries using a tolerance of 0.001 .It does not give an error, it just gets stuck.If I dissolve the clippers before clipping, it does work. So I'm guessing there's something 'wrong' with the geometries (there is a strange pointy shape in the polygon) and the chosen tolerance, but I don't know why it gets stuck. I'm guessing the pointy-bit is too small and falls under the tolerance? I'm using fme 2022.1.2. Workspace attached and data attached.

80
danminneyatsaf
Safer
johnk
Contributor
johnkContributor
asked in Transformers
How to avoid gaps when applying DEM values to points

Hi,I have a process where I am using a DEM to apply values to vertices of polylines using vertexextractor, point on rasterextractor etc (see below). But I end up with gaps where the z value has been attributed as -32767. These have occurred where the vertices are just outside of the clipped DEM - is there anything i can do to interpolate?

220
danminneyatsaf
Safer
R
rhysdixon8
asked in Transformers
Is there any way to access/export/restore features in a temporary file?

Hi all,​I have a lengthy workbench running. I can see the temporary files being written to the relevant 'wb_run...' folder specified in the translation log. The workbench has just finished writing outputs of an AreaOnAreaOverlayer, and those outputs are now being used as the input to a Dissolver, which is in progress at the moment. I can see a 29GB file named 'FME_OBJC_DissolverInputAreas...'. Is this a temporary hold of the AreaOnAreaOverlayer output features? If so, is there any way to use this temporary file and access/export the features in it? In case it is relevant - I have feature caching turned off. Thanks!😀

370
hkingsbury
Celebrity

Badge Winners

  • Webinar Watcher (Grey)
    arxit_cbuhas earned the badge Webinar Watcher (Grey)
  • German Speaker
    janakhas earned the badge German Speaker
  • English Speaker
    janakhas earned the badge English Speaker
  • Welcome Back
    arxit_cbuhas earned the badge Welcome Back
  • Integrate Spatial Data
    remcodigireghas earned the badge Integrate Spatial Data
Show all badges

Community Stats

31,818
Posts
120,846
Replies
39,446
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.