Using transformers to modify data.
Recently active
Hi,I need to exclude all XML attributes beginning with "questionnaires.que_ans"The following XML is being return from - HTTPCaller - XMLFragmenter -Many thanks. questionnaires.que_ans{0}.ans (encoded: utf-16) questionnaires.que_ans{0}.ans_value (encoded: utf-16) questionnaires.que_ans{0}.que (encoded: utf-16) questionnaires.que_ans{1}.ans (encoded: utf-16) questionnaires.que_ans{1}.ans_value (encoded: utf-16) questionnaires.que_ans{1}.que (encoded: utf-16) questionnaires.que_ans{2}.ans (encoded: utf-16) questionnaires.que_ans{2}.ans_value (encoded: utf-16) questionnaires.que_ans{2}.que (encoded: utf-16) questionnaires.que_ans{3}.ans (encoded: utf-16) questionnaires.que_ans{3}.ans_value (encoded: utf-16) questionnaires.que_ans{3}.que (encoded: utf-16) questionnaires.que_ans{4}.ans (encoded: utf-16) questionnaires.que_ans{4}.ans_value (encoded: utf-16) questionnai
I'm just a newbie with fme and I'm having very basic problems when working with transformers.First off, I want to connect several readers to the input Root port of XML Templater. The transformer shows no error when I do it, but when I run the workspace it does generate an error since only the data of one of the inputs is taken into account but the root template needs values from both inputs.Working with sub templates is not an option for me as I will never really know what elements in my xml template will take values from one or another input. I have no control on the key-value pairs present in each json input.
Hello,I have a project that involves creating maps and custom outputs with the HTMLReportGenerator and would like some help with GeoJSON. I am utilizing custom code to add a second geojson layer to the map. is there a way to take an imported file (ex: ESRISHAPE) and convert it to geojson inline (maybe as an attribute?), and then use that geojson output(text) as a parameter in my custom code.Edit:A good example of a perfect geoJSON output is how the HTMLReportGenerator converts both attributes and geometry to geojson.
Hello, I'm attempting to extract strings from a text file that comes after specific key words. I only need to extract the X,Y coordinates from the text but I need to preserve what values they correspond with. In my example these are well points and I will need to keep the location for each one. I have the following keywords:GEOLOGIC FIRST TAKE POINT:BOTTOM HOLE LOCATION:LAST TAKE POINT (TIV):I only need the X,Y coordinates that come after these key words, but I'm having trouble getting my regex expression to pull the X,Y data following each key word as there is text in between I don't need. I've attached a sample of my data below. FIRST TAKE POINT / GEOLOGIC FIRST TAKE POINT: WORDS IN BETWEEN WHAT I WANT TO EXTRACT X = 5,498,257' Y = 789,958' LAT LONG LAT LONG (NAD27) (NAD83/86) LEGEND: (PSL) - PROPOSED SURFACE LOCATION (PP) - PENETRATION POINT (FTP) - FIRST TAKE POINT (GFTP) - GEOLOGIC FIRST TAKE POINT (LTP) - LAST TAKE POINT (BHL) - BOTTOM HOLE LOCATION (r)
Hi,I am trying to do a spatialJoin between a records table with lat, lon coordinates that lives on AWS Redshift, and a shapefile that lives on my local PC. The final goal is for this join to then be imported into tableau and visualize the data as a choropleth map showing number of records per shape.However, for some reason this is failing for me and I have no idea why.Below is the ETL diagram:As you can see no output is going to inspector called PointsOnShape - suggesting that no point found any match with the shapes. I have plot the points and shapes on tableau and there's definitely overlap.ShapeOnPoints Inspector shows also no overlap, and gives an error:On the other hand the RejectionsIns shows a clear error: INVALID_POINT_GEOMETRY_VERTICES. But I have no idea how to handle it or what I may be doing wrong.This is just part of my ETL workflow because ideally I'd write this data to redshift and then consume it in Tableau but wanted to start by fixing this issue.Thanks!
HiI have a csv file with lines that relate to each other purely by the order they appear in the file. So all the records with a record type "1" are the main record and the lines below with 2, 3, 4 or 5 record types relate the record above with the type 1. There could be any number of lines below and you only know when you get to a new record because you get a new record type 1. I would like to assign a new field with a common ID to the lines that refer to the same property. So in the first example the 8 lines would have a common ID and then the next 3 lines a different ID.1 106 London road 2 Ground2 Ground2 First1 104 London Road2 Stores3 Offices1 Retail4 Car ParkingAny help gratefully received.ThanksRuth
I need to create a list (or repository) of all the unique words in multiple data sets attribute tables. I was able to create a list of all the unique attributes, but now I need to go one more level and break out those attributes into individual words.For example, let's say my unique list of attributes are:The Dog The Cat Bird Three DonkeysI need to take that list and create this list with it: The Dog Cat Bird Three DonkeysDoes anyone know how I might achieve that?Thanks.
Hello, Is there any way to use SystemCaller to call on the terminal of a remote server?We have FME server hosted on a computer. We have another program hosted on a Google virtual machine. It is a linux based machine and I run a couple of simple commands there. I would like to be able to do that using FME Server.Thanks.
Hi,Is there a way to replace a point (Origin was from a point cloud) with a symbol from a DWG file?And I also want to scale the symbol in x, y and z with values from a attribute from the point.For example the attached And the output format can be a Shape or DWG file.Best regards,Jonas
I'm attempting to process 1,000's of Mastermap native Gz files in to TAB format. As the maximum file size for standard Tab files is 2Gb is there a way to get FME to split output in to multiple 2gb files?
Hi, I have a geometric topology with nodes and lines. Some lines have not the right end coordinate and are therefore not "connected" with it's node (shown on the left side). I'm looking for a solution to "snap" somehow the lines to the respective node depending on the line-attribute Node_Reference (shown on the right side). Is there a matching transformer available? For example: the red node has the attribute Name: ID_1. The blue lines has an attribute Node_Ref: ID_1. I would like to replace the end coordinate of the blue lines (nearest end of the line) by the coordinate of the matching node.
How do I set an attribute value in attribute manager that does not include quotations once I load it into Smallworld?
Hi,Has anyone looked into logging to a Gibraltar Loupe logging service ?My company is currently looking into creating a central logging facility for all our applications and services, and FME conversions are not exempt from this.It may be converting normally generated FME logs, or preferably, logging directly inside the workspace, e.g. by using a PythonCaller or a a custom transformer.Any insight on this issue is most welcome.Cheers Lars
What is the best method to remove 75+ attributes from a file with 500 attributes? Is there a way to use a list of the attributes 75+ attributes to parse from the 500?
I am parsing a very large xml file. After using the XML reader, my intention is to widdle down the data by using a series of constraints before writing to a database. I first tried to do this by stringing together multiple attribute filters, however I was unable to get my results from the first attribute filter transformer passed to my second, etc. Documentation suggests the Test filter would be a better route anyways. Despite knowing that my data satisfies the query statements (I tested this in another environment) I have added to the test filter transformer, I cannot get the transformer to pass any data through.I have also tried to achieve the same task via stringing together testers, as well as stringing together test filters (1 statement a piece). Does anyone know why I cannot get this to work? Thank you ahead of time for addressing this post.
Hello, I want to use Point on area overlay transformer but it does not work and I don't know why. As You can see here some points are overlaying the buffer I created but output is collapsing.
(I asked this question in here, https://knowledge.safe.com/questions/1935/distance-between-points.html?childToView=64766#answer-64766but I figured I probably needed to make a separate new post, since it involves a different set of issues.)I need to calculate the distance from each point feature in a point dataset to each polygon feature in another dataset. I've used the neighbourfinder with the maximum distance set in such a way that it will include all the features involved. I also set the number of neighbours to the amount of polygon features I have.I set the list name.After that I used a list exploder to get a list of all the distances from each point to each polygon. That seems to do the job. However, how do I now transpose the list?I get a table with the amount of records equal to the number of point features multiplied by the numer of polygon features. I want a table with the same amount of records as the point featurues, and added to it the distance to each polygon feature
Hey!I have a problem with my PostGIS database. Trying to get it much more efficient. It contains information from several counties, which means I read a lot of unnecessary information that I do not need and the computer is giving up. Something similar "Fastkart.ak = '2085' and all information within 2085 from Fastkart.by" is what I need to do. But can’t figure out how. I’ve tried many hours to write clause under feature type and also by using sqlexecutor. Figure 1 shows all tables in the database. Often when I am going to read information from my municipality, it must read all the municipalities' buildings eg which makes it very big amounts. Of course, you can drive a clipper directly after the base but would be better if I could get the data base to read no information other than it by 2085. Anyone know if it’s possible to write "Where clause" directly in the database when you do not have matching information I attribute table?(That would be the best op
Hi, I am running a workbench which uses system caller to run a bat file ad that bat file in turn runs a exe file. When I run the workbench from any location other than the same folder as the bat and exe files it fails to execute. What I want to know is how can I pass through a published parameter value to the command prompt temp variable %%1 so I can set a folder for it to be run from?Thanks,Clare
I am trying to use SpatialFilter to get polygons that overlap but it also includes polygons that touch the edges since I am using the "Filter Intersects Candidate" option. Has anyone found a workaround for this issue since there isn't an option to only test for overlaps?Thanks
Hello, I have a source file with Points of intrests and thier x/y coordinations. I would like to compare them with the database extract with also having this information. The problem is that they might not be on the same exact spot and also the names can vary a little. I was having an idea of using neighbour finder and then check the naming by using fuzzy string comparer but I struggle with doing it properly. Maybe there is better way? Thanks,
I have a dataset consisting of polygons. The polygons represents roads. Along these roads I need to find certain points and the distances between them. I've fed the dataset through a chopper and coordinate extractor with a point replacer to get the vertices. Now i need to measure every single distance between all points in the dataset to find the maximum ditance between any two points in the dataset. I've tried every possible combination of transformers, but no luck. No one else seems to have the same problem either, because after about four hours of googling and testing, I've been able to measure a whole lot of things, but not what I really want to measure. Using the length calculator has proven to be the best shot so far, but the problem I'm facing is that the length calculator takes the vertex with the highest node number and measures the distance from that point to every other point. Basically I would like to do the same for every point in the dataset. Any sugg
Hello FME community !I've a treatment with MDB destination and I would like to ZIP this MDB at the end of the WorkBench but with a size specification.For the moment, I used this article and the result is a unique ZIP file so fat.What I want is (like 7-zip) to divide this file in different volumes with a userdefined size.In the better world, I would like before this operation to send an e-mail with this ZIP file.Can you help me ?Thank you.
Hi everybody.I try to recept the result of a cmd code used in a SystemCaller transformer :In fact my SystemCaller works with my result (in this case : 3)But in facts, the result is not saved :What can I do for resolve this ?Thank you for your help.
Hycan you explain how can use fuzzy to detect names present in list A but missing in list Band viceversa ? thx Francesco