Using transformers to modify data.
Recently active
I am looking to filter out specific types of addresses from a full dataset of addresses. These addresses include points that can represent the main address (ADDRESS_BASE) (ex: 123 main street), or addresses that include a suite addresses (LVAPT_ADDRESS) (ex: #3, 123 main street). Scenario 1: If the main address and the suite address are all stacked at the same XY, then I want to select the main address (this isn't hard)Scenario 2: If there are groups of suite addresses with the same main address on a building but with each slightly different XYs then:Option A: if the group with the same main address is all on one building then select the main addressOption B: if the group with the same main address is on more than one building then keep all addresses. My brain is getting tired of running through different ways to make these different kinds of selections/filters. I have tried the Matcher because it includes a MATCH_ID value, but the MATCHER seems to require the points need to be exa
Hi, I have a landscape colored after value, and when I press inspector before features are written I can see them in perfect colors as they should, but when I open the written dwg in AutoCAD or Bentley Viewer everything is just red, and I dont know why. Pictures: The lines in wireframe view and conceptual view etc is just the same color in Autocad even when the look fine when inspected jsut before written, I tried using Regions instead but doesnt work.
Hello, i want to use as input for the pointcloudcombiner certain files, which i have written in different attributes (neigbor_[0-7] of one feature (eg 2671_1262). These are the neighbouring tiles of lidar data. So far I have not found a way how I can pass the attributes (complete file path + filename) or a list as input to the PCCombiner. Is there an elegant way for this in FME?
HelloAfter an "attributeKeeper" transformer I try to obtain a selection with distinct value for each row like a "select distinct" sql command. But I fail to find a good solution. (I didn't find the DuplicateRemove transformer)Do you know to do it ?Thanks
I am downloading my survey123 data from ArcGIS Online Feature Layer, and trying to convert the stored UTC into Local Time, and I have been provided this code, from this thread: @TimeZoneSet(@TimeZoneSet(@Value(shift_start),local),utc,convert) It initially looked good, but now I am looking closer at the results I am seeing the converted data is all out by +2hr. Where I should be seeing it converted to 8.30am, they are all showing as 10.30am. And today we have started 'daylight savings' where we adjust our clocks by 1hr, my dates are instead showing as +4hr out! I am pulling my hair out as I have no idea where to start looking to resolve!I am unsure why this could be? Is there an adjustment I should be making? Is it a setting in FME? I am in Sydney Australia time zone.
Hi,i am using an AttributeValueMapper where i import an excel file. In the preview the encoding is correct, but when i complete the import steps, the encoding gets destroyed. I dont find any option to change this. Are there options to correct this or is this not possible or is this a bug?i am using FME(R) 2019.1.0.0 (20190710 - Build 19608 - WIN64)RegardsClemens
I am needing to test a DWG contains certain features for example a north point. If the drawing contains the layer that the north point is on I can use a range of functions to test if it exists i.e. tester, statisticsCalcultaor, etc But what if the north point is missing and therefore there is nothing on that layer, how do you test for its non-existence?
Hi,I am using FME DonutHoleExtractor to identify (and eventualy remove) the inner shell of donut polygons on Cadastral Maps.Isolated inner shells are easily removed but in my data there are many encircled polygons that share one or two boundaries with the outer shell. In the image below I show two examples of this situation (A and B) and also an isolated inner shell (C).Is there a way to select/identify this kind of encircled polygons with FME?Thanks, Oscar
Hi Community, No question, just a tip to share... For a workflow we have to check for new observations in an ArcGIS Online Feature Service and send an email to relevant stakeholders. AGOL time is in UTC whereas the email is send in local time. To notify the right times we had to convert the AGOL time to local time and the email time to UTC. We use AttributeCreators for that. Below we share the code used for these conversions: # Convert input time (in UTC) to local time## Author: Egge-Jan Pollé, Tensing GIS Consultancy B.V.# Date: 24 October 2018## The date we get from ArcGIS Online (SRNL_CREATED_DATE) is in UTC.# To convert it to local time we first have to set the time zone to utc:## Step 1: @TimeZoneSet(@Value(SRNL_CREATED_DATE),utc)## Next we can convert it form utc to local:## Step 2: @TimeZoneSet(<Output from Step 1>,local,convert)## We can nest this like below:@TimeZoneSet(@TimeZoneSet(@Value(SRNL_CREATED_DATE),utc),local,convert)# Convert input time (in local time) to UTC#
Trying to use DateTimeConverter to conver Oracle Date to PostgreSQL timestampz. Have tried multiple formats.Value of attribute 'start_date' could not be converted to type 'timestamptz'. Feature will be logged and skipped
The "Datos" table stores weather stations data. This query retrieves data from 00:00 to 05:00 (2020-03-29).This is my FME workspaceThe inspector window shows:In the "Fecha" column, dates from 02:00 to 02:50 are duplicated. Is it a MSSQL_JDBC_NONSPATIAL driver issue?
Hi, I want to dissolve all polygons that are under 1.5m2 into neighbouring polygons. I have managed to merge the 1.5m2 polygons that only intersect one other polygon. But with regards the rest, I want them to dissolve into the largest polygon it intersects. For example, if a 1.5m2 polygon intersects a 100m2, 200m2 and 300m2 polygon I want it to always chooose the 300m2. Thanks very much for any help. Kind regardsB
HiI have a tiled point cloud.I want to be able to test/check what tiles are intersecting, within, touching etc with polygons from a shapefile.If a tile is overlapping then the part that's inside the polygon needs to be ground filtered. The other part needs to stay the same.It seems that the spatialfilter doesn't work with a point cloud. I get the wrong geometry message. Is there another way or another transformer I can use? *** Dont forget the World Tour Webinars: TUESDAY, MAY 5 2020***
Hello,I am converting a sewer network from CAD to GIS, and am attempting to convert flow arrows to flow direction in the output GIS geometric network. I have already successfully built out the conversion of the actual sewer features to GIS, and all I have left to do it get the flow direction set up.The flow arrows are drawn as triangular solids with separate lines (on the same CAD layer). Does anyone have any advice on how to convert this to flow direction in a GIS geometric network? I'm assuming the workflow will involve snapping the flow arrows to the corresponding lines, but beyond that I'm not sure how to approach this; I'm way outside of my FME experience level here. I'm guessing the Angle attribute of the line component of the flow arrows may come in to play as well. Any suggestions of transformers and order of operations are appreciated. Thanks.
My duty is to read multiple CSV-Files my means of HTTPCaller from an online source into an attribute each, subsequently zip the CSV-file inside the very attributes, and finally write the binary attribute content (zipped CSV) to a PostgreSQL bytea-Attribute.I know how to read the HTTP source and write into the bytea destination attribute.QUESTION: How am I to zip a CSV-file inside a binary BLOB FeatureType attribute within the FME Desktop Workspace.Hint: I tried to use the ZipArchiver, but that one needs a file as source, as well as destination, but wouldn't work on attributes. Many thanks for any effort!
I am trying to download a specific set of files from an FTP server. First I use an FTP caller to download to an attribute so I can select the filenames of the files I want. Then I use another FTP caller to download teh files. It seems to download fine, but all the downloaded zip files are corrupted. How do I fix this?
Hi folks,I don't know if it's a "new" bug. when I configure a reader DWG in grouped mode (single merge feature type) but not directly when creating the reader, but afterwhile, in the parameters of one of the faeatures :The number of entities increases anormally ... and do never represent the real number of entities presents in the layer.For exemple, I have 3000 entities (block) in a layer.If I check the box "merge feature type" it increases to 20000 without reason.I am surprised because I used this function a lot of times, without any problem.Does anyone know if there is a problem known about it ?Or maybe I do the bad manipulationRegards
In my workflow, I want to evaluate the intersection of a circle with a set of lines, extract the vertices, do some calculations, then store just the text results in a table. The set of lines remain the same but a new circle is created for each intersection analysis using a different circle center. There are 200,000+ circles whose intersections with the set of lines that need to be evaluated.The workflow I created works for a single circle (using the Sampler to extract the circle) but when I want to evaluate multiple circles, the all start to overlap which doesn't provide the desired results.How can I run the intersection of the circle with the line set one at a time and write out just the text results for each circle? I tried GroupBy in the Sampler2 but didn't get the desired results. I'll try to have the image and workflow posted with the question.
This seems like something someone would have done already, but has anyone created a workflow to generate a point from a PLSS (Public Lands Survey System) description, such astownship 45N Range 43W section 20, NE, SW, NW, SE ? Any thoughts how to go about that ? not all are down to the QQQQ, some are only QQ, etc
Does the connector support parquet? Getting a forbidden error. Any suggestions on privs of the account required.HIVE_CANNOT_OPEN_SPLIT - com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden;
Hi all, I'm attempting to set up a custom XFORM_DEF to move between CSRS (1997) and CSRS (2010) using the grid shift file CVG69710.gsb provided by NRCAN, and I'm having trouble getting it to show up in FME Options > Coordinate Systems. I was wondering if anyone might have experience setting up this transformation or if anyone could otherwise spot what might be going wrong. I've placed the grid shift file in Reproject\\GridData\\Canada and placed this definition in the bottom of the MyCoordSysDefs.fme file. I also did a test by uncommenting the ASTRLA66-Grid_to_GDA94 XFORM_DEF in the same file and it shows up in Workbench without issue.Here is my custom definition:I was thinking that perhaps I need another datum to represent either CSRS (1997) or CSRS (2010), but I'm not really sure. There seems to be some ambiguity surrounding the representation of different CSRS realizations within the EPSG code system and I am unsure which is being represented by the CSRS datum I&#
Good afternoon, I have a Multipatch Building Data Set (LOD2) (*.GDB). Consisting of wall and roof areas. Since only the roof areas are interesting for my further work, I would like to extract them into a 3D polygon. Unfortunately, there is no attribute that tells me that the polygon is a roof surface or a wall surface. Is there a transformer which separates the corresponding roof area? If this is not possible, my idea would be to calculate the inclination for each polygon and define all polygons with an inclination of ~90° as a wall. For this I would consider the transformer "SlopeCalculator". Is there perhaps a more efficient way to reduce the calculation of the inclination of several million polygons?Thanks a lot.
Hello FME family,I am new in using FME and I really want to learn more about the software.I have FFS table that I want to write in PDF. Also in the PDF output, I want to show the number of time a feature (string) occur in one of the attribute columns. I will appreciate a tip on how to go about it because I have tried all I know but not working.Thank you.
Hii,I have a .rvt file that I have georeferenced in Revit (epsj 23032 - UTMED50 32N). Now, my target is to visualize that file in FME. I'll show you how I tried to do it:In the first figure I show you about the Revit survey point, and for me it's ok. Because the coordinates values are coerent with the coordinate system of the project.In the second figure I show you about FME reader setting that I have used.When I use the reader to import the file in FME Desktop 2020 the model don't match with the correct location :-(Someone can help me!!!RegardsGianpiero
i have lines and points ,both of them as input .i want to find which lines intersectes with points and which notand show me the id of each station that line intersected so i tried by point on line layer and neighbor finderand it find correct data of overlapped point but i have still problem,when one line intersected with two points ,the output that i got only id of this line and and overlap 2 and name one of the two station .it did not show me the 2 stations that line intersectedso i noticedthat it checked only by xmin and ymin of the line which point intersected . this is the station that it has chosen and another point at end of the line ,it did not show me bcs it is xmax and ymaxbut the line intersected with 2 point as the output said 2 overlap,so how could i solve this problem .and i get id of each 2 pointand i tried also neighbor finder but both of them works with xmin ymin close candidatehow could i let both of them work with xmin ymin and also x max y maxbcs it means also if i