Skip to main content

Transformers

Using transformers to modify data.

  • 10k+ Posts
  • 53,090 Replies
10000 Posts
nicolae.soare
Participant
nicolae.soareParticipant
asked in Transformers
lorenrouth
Contributor
lorenrouthContributor
asked in Transformers
Using Python Caller for Multiple Features and Feature Types?

I am working on a script that uses the OpenIfcShell library to create IFC files as a workaround for the IFCWriter's gap in functionality.  So far so good:  I can create the basics of an IFC file using one feature.  Now the challenge is to scale up with a dataset that has many features and feature types.  Here is the code I have so far:import fmeimport fmeobjectsimport uuidimport timeimport calendarimport tempfileimport ifcopenshell class FeatureProcessor(object):     def __init__(self):        pass     def input(self, feature):                # Create FME Log File object name called logger        logger = fmeobjects.FMELogFile()         # Call logMessageString method to add custom text and set WARN severity level        logger.logMessageString("Testing the mud",1)                        ifc = ifcopenshell.file(schema='IFC4')

1702
lorenrouth
Contributor
G
ganeshmoorthim
asked in Transformers
How to extract value from json and insert record in Postgres DB?

In my case, I have JSON object that contains table and it values in array. I am trying to extract each table object from JSON and insert it features(columns) array values into postgresql table based on table name. The json structure will change every time and it is dynamic. Input:{  {    "table": "Table1",    "key": "2343",    "features": [      {        "status": "Finished",        "id": "1234",        "kind": "Unknown",        "project_name": "XXXXXX"      }    ]  }  {    "table": "Table2",    "key": "2667190",    "features": [      {        "column1": "test",        "column2": "A",        "status": &

750
M
M
marinadore
asked in Transformers
danilo_fme
Celebrity
danilo_fmeCelebrity
asked in Transformers
M
mger1974
asked in Transformers
How to retieve data from text file that resides on multiple lines

Hi, I have a problem extracting data from my text file.The file looks like this:******************************************#Textlimiter=;#Decimalsign=.#ProvadmColumn1, Column2...ColumnX;"Value1";"Value2"...""ValueX";"Value3";""Value4"..."ValueY";#ProvdatColumnA, ColumnB...ColumnZ;"ValueXX","ValueYY"..."Value11";"ValueQQ","ValueRR"..."Value22";#End******************************The ProvAdm-section can contain one or more rowsThe ProvDat section can also conrtain one or more rows I want to read ProvAdm section into one table (SQL Server) and ProvDat into one table (SQL Server) but I dont reaaly understand how to find out where ProvAdm section ends (how many rows should be read) or where ProvData starts (where should I st

3105
geomancer
Evangelist
S
sam.27
asked in Transformers
J
joelavigueur
asked in Transformers
knutos
Contributor
knutosContributor
asked in Transformers
Hi, I have encountered a strange FME Engine error. Any suggestions?

The error occurs once in a while in a Workspace that is reading a PostGIS/PostgreSQL 12.9 database and writing a GEODATABASE_FILE using 64-bit ArcObjects from underlying an ArcGIS Desktop 10.8 installation. The error is triggered in a DatabaseJoiner, when attributes are joined in from a PostgreSQL table and written to the File Geodatabase simultaneously. The error happens once in a while (every second run or so), but it does strangely not occur on a PC with 64-bit ArcObjects from underlying an ArcGIS Desktop 10.4 installation or in any other variants of the workspace writing to other formats. The error occurs both on Desktop and Server. FME version is 2020.2.3. The error message does not say anything about the GEODATABASE_FILE writer, only the PostGIS reader, but the writer is obviously a part of the problem. If I disable the writer, nothing happens. If I bypass the DatabaseJoiner nothing happens. The message POSTGIS reader: stk::ex::bad_expected_access is discussed el

2780
mark2atsafe
Safer
S
spalka
asked in Transformers
swach
Contributor
swachContributor
asked in Transformers
ienesaglam60
Contributor
ienesaglam60Contributor
asked in Transformers
J
jdaswani05
posted in Transformers
S
stevens
asked in Transformers
JSONTemplater, double counter in for loop

Hi All,Helped by info in this forum I constructed a loop in the JSONTemplater, to loop through a list and make a json array based on info if a certain condition is true. This works, I use a $i to reference to the index in the list. In a different counter $c I would like to keep up with how many values are entered i the array and use this value in the array as wel, but I can't get the $c counter to count up.This is what I have so far:[{let $top5s := fme:get-list-attribute("_prio{}.top5")let $themas := fme:get-list-attribute("_prio{}.thema")let $deelthemas := fme:get-list-attribute("_prio{}.deelthema")let $c := 0for $top5 at $i in $top5swhere xs:string($top5s[$i]) eq "Ja"let $c := $c + 1return {"titels": "Projectambitie " || $c ||": " || $deelthemas[$i]  ,        "teksten": "Op basis van de locatie vraagt " || $deelthemas[$i] || " aandacht in je project."    }}]It works, only

762
S
izabreton
Contributor
izabretonContributor
asked in Transformers
D
dominikl
asked in Transformers
T
trevor1
asked in Transformers
T
torstenschramm
asked in Transformers
JSON Array to table

hi,I have the following json time series and would like to convert it to a table structure.so per time and value an own row with all station information.Unfortunately I can't find a corresponding example in the FME help. [    {        "ts_id": "19690010",        "station_name": "Badinghagen W",        "station_latitude": "51.084693593981505",        "station_longitude": "7.650786142144193",        "parametertype_name": "Niederschlagshöhe (N)",        "ts_name": "Tag.Summe",        "ts_unitname": "Millimeter",        "ts_unitsymbol": "mm",        "station_no": "13100039",        "station_id": "12918",        "rows": "4",        "columns": "Timestamp,Value",        "data": [            [                "2022-03-18",                0.03            ],            [                "2022-03-19",                0.00

10730
T
datablue
Contributor
datablueContributor
asked in Transformers
C
chris28
asked in Transformers
Spatial filter not giving the correct result.

I have a spatial filter that isn't giving me the correct result. I am trying to determine if a feature falls within a polygon. If it does it should pass. If it doesn't it should fail. I know the feature is within the polygon and therefore should be 'passing' but instead it keeps failing. I'm assuming I have something set incorrectly. These are my parameters: Filter type: Multiple FiltersPass Criteria: Pass against one filterSupport Mode: Support aggregatesSpatial Predicates to test: Contains candidate, touches candidate, intersects candidateUse bounding box: noCurve boundary rule: Default rule Merge attributes is selectedAccumulation mode: Merge FilterConflict resolution: Use candidate Preserves Feature Order: Per output port

3686
C
S
samuel.wsp
asked in Transformers
magi
magi
asked in Transformers
STEP by STEP guidance to obtain desired results to be filled out in EXCEL

PROBLEM 1 if in column TYP the value is PL than do nothing (keep the cell G1, H1, I1 empty) ******************************************** PROBLEM 2 if in column TYP the value is PEthan calculate value in "x1 in (m)" check condition "F is W" or "F is E" or F is S" here the condition is "F is W" so fill in default value from "Y in (m)" to "y1 in (mm)" and from "Z in (m)" to "z1 in (m)"   FORMULA to calculate/obtain value in "x1 in (m)" i.e. 1960.85 from the DIM in (mm) always select the first value before "x" for i.e. 600 and convert it from millimeter (mm) into meter (m) i.e. 600/1000 = 0.6 now add the result i.e. "X in (m)" + "0.6" ******************************************** PROBLEM 3 if

110
M
chrbalm
Contributor
chrbalmContributor
asked in Transformers
smfks911
smfks911
asked in Transformers
How to compare and detect change between a non-spatial table with a feature attribute table?

I would like to be notified if there is any wrong attribute value in a non-spatial table which is read from SQL database by comparing with an spatial attribute table. In other way, I want to detect change if the attribute of a particular entry/row is different from each other. I have intentionally changed attribute values for two entries so that these two are picked. Both tables have few common fields but the schemas of the tables are not same. I have tried with changeDetector, Matcher and DuplicateFilter but not getting the actual outcome. Any help will be very appreciated.  In the attached image, 1 is the non-spatial table and 2 is the spatial attribute table. I have used attribute manager so that the attribute names in interest in both tables are same.  

3160
geomancer
Evangelist
tcrossman
Contributor
tcrossmanContributor
asked in Transformers
Would multiple, simultaneous SurfaceDraper transformers significant decrease processing time for a workspace?

In your experience, would splitting the feature flow and directing it into multiple, simultaneous SurfaceDraper transformers significantly decrease the processing time for a workspace, all else being equal? Let me explain what I am dealing with and why I ask ...I have 730K points (center points of square grid cells) and 2.1K triangular 3D polygons, overlapping with each other in both 2D and 3D. For each point, I must identify the triangles it intersects (in 2D) and identify the triangle that is lowest at that point's location, extracting the triangle's z-value as an attribute. For that, I use a SurfaceDraper -- see the screenshot above. Points and triangles go through a PointOnAreaOverlayer with output of both points and areas, and those two flows are directed through ListExploders to end up with two matched sets of equal size as

321
nielsgerrits
VIP

Badge Winners

  • Integrate Data with the FME Platform Training
    eduaicmir001has earned the badge Integrate Data with the FME Platform Training
  • Integrate Spatial Data
    kasturideb23has earned the badge Integrate Spatial Data
  • English Speaker
    tdzkj88has earned the badge English Speaker
  • Welcome Back
    russellmhas earned the badge Welcome Back
  • FME Form Basic Training
    russellmhas earned the badge FME Form Basic Training
Show all badges

Community Stats

32,207
Posts
122,305
Replies
39,891
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.