Using transformers to modify data.
Recently active
I just ran a workspace in Workbench 2019 to analyse software concurrent usage data. Basically the dataset contains a feature for each instance a user fires up a piece of software and includes a start and end time. The dataset only covers 4 or so weeks and has 55,466 features...not huge by any means.To solve this problem I plotted points for each start time and lines by using the end time as the 2nd coordinate (y=0, X1=Start, X2=End). Essentially this produces a Gantt chart with all lines and points on the X axis. Then I use the PointOnLineOverlayer to find how many lines lie under each start point, which gives the number of users at each point in time. Sorting for that count then gives the maximum concurrent usage.The problem however is that this transformer splits each line by the point above it FIRST, before it processes the points output. So I ended up with 31,829,560 new line features that I really don't need! As a consequence, it took 5 hours & 14 minutes to run the worksp
I want to read a file from trimble connect. Let me know how to call trimble connect path in reader
I' am reading a csv file and all attributes have the type char. If i connect an inspector it automatically converts some values to date-time. Can i disable that? I want to see the original, not converted data,
Hello FME community, please forgive me if this is a trivial question. I am quite a beginner with FME.I have a line shapefile containing streets. Each street presented with more than one line (Lines Group) and each lines group belong to the same KEY and NAME as shown in figure one.The problem is that, for each street I need to keep the line near to center (center of group) and remove other lines as shown in figure two. My initial idea was to create a Bounding Box for each lines group (each street) then creates a Center Point for each Bounding Box. Later on to match each group lines with their center point, and then remove the duplicates with keeping the line near to center.I am stuck on exactly how I would remove the duplicate with keeping the line near to center? And how I match each group lines with their center point?For creation of Bounding Box I used (Aggregator Transformer - Group By: key and name >> BoundingBoxReplacer – 2D Oriented) .For creation of Center Point I used
I have a geotiff (sentinel-1 SAR) that i can view correctly in ArcGIS. It shows in ArcGIS properties as being GCS_WGS_1984. If I read it in FME and write to another tiff it is also fine. But within FME it seems to lose the geographic contect and switches to Coordinate system: unknown and in the inspector displays as if the pixel values are geographic coordinates. This means that I cannot perform any geographic operations on it (I plan to use rasterextentcoecer and mapnik). Is this an issue with my reader, or can I reintroduce the location? The tiff has no world file so I dont actually understand where the georeferencing is stored - but arcgis can read it.
I have multiple spreadsheets that are emailed to a specific address and stored to a file folder. All of these sheets will contain slightly different headers, however, every spreadsheet will at least have a common identification attribute.Is there a way I can build a workbench to read through all of these excel files to search and extract this ID number from all excel files? Thanks in advance for your suggestions!
I am working on a project were I'm dividing a list of addresses into 18 zones. It is very similar to the Garbage zones exercise in the FME Basic course and I have used part of that work space to create the work space I'm using for this project.Its point data to polygon data, but the issues is at the end of my work space, the final result has a ton of large gaps between the polygons, and I'm not sure how to fix that.Is there a way to snap the edges of the polygons to another data set of lines, like a road layer? I should specify I have tried to use the AreaGapAndOverlapCleaner, as well as the combination used in the FME Basic Training of AreaOnAreaOverlayer to PointOnAreaOverlayer to ListHistogramer to Dissolver. It may be that the AreaGapAndOverlapCleaner does not have the correct parameters set, and that is why its not working
I'm working with two sets of data with nearly identical, but not quite matching, IDs. Ideally I'd like to join together rows where:|requester_id - supplier_id| < 0.1Is there any way within FME to accomplish this? Only way I can think of is to do a cartesian join and filter the results, but for this data the cartesian join would result in billions of rows and I'd like to avoid that.
I have sqlcreator which has simplest ever query which selects all fields from a geodatabase table. The SQLCreator does give out the result in an inspector but at the same time throws the following errors.What am I doing wrong here?FME Desktop: 2018.0.1.1
Dear FMExperts,I am using the AreaGapAndOverlapCleaner transformer to find geometric issues within a polygon dataset. I can output a list of all the features affected, but what I would really like to achieve is to produce a list of each instance where a geometric error has been discovered, what the issue is, plus the coordinates for the location.So something like this for each found error:FEATURE_IDISSUEXY123Gap123654244440124Gap123887249486124Overlap6454772757154 TIA,R
Hi, very new to FME so I'm sure there's probably a very easy fix for this but I can't seem to find one anywhere. I have an XML file I'm trying to read, and one of the attributes has a one-to-many relationship with the parent feature. When reading in the XML, the data for this attribute will be read in when only one instance of the attribute occurs. Where multiple instance of the attribute occurs, the field is missing. Example below: The attribute <Activity> is read successfully for instances like this in the XML file:<FacilityReport><NationalID>Example1</NationalID><Activity><RankingNumeric>1</RankingNumeric><ActivityCode>5.(b)</ActivityCode></Activity></FacilityReport> But <Activity> will be missing for instances like this:<FacilityReport><NationalID>Example2</NationalID><Activity><RankingNumeric>1</RankingNumeric><ActivityCode>5.(b)</ActivityCode><
Hi all, I used views in SQL Server Spatial as source dataset/format in FME. Inside the views I created geometry column. Now, I need to make Stored Procedure instead of view. My question is: What are differences by using SQLCreator as "Reader" instead of real Reader? What about performance and so on? Is there some better solution or?
Hello,This question is primarily caused by this being my first python class implementation in FME. The basic question is? How do I output a new set of features while not outputting the original ones? Details below:I am reading in a set of features to a python caller -class-appending them to a dictionary which in turn is converted to a pandas dataframe for analysis on the set of dataIssue: I have been having trouble outputting the new data in the way I want to:What I wanted to do was "drop" the original input fme features and create a new set of features with the new values based on the dataframe. I wanted to do this as I thought it would be quicker than matching the new values to the original input featureThe issue is shown in the last loop of the code where newFeature = fmeobjects.FMEFeature() is used to create a new feature and assign attribute values, but in the end I am calling self.pyoutput(newFeature) which I believe is referring to the object created from the input featuresHow c
I am going to make CAD into 3D models ,and I encountered some problems in this process.The original data file geojson (pre-transformed DWG into geojson file), fmw has been uploaded, and the WALL layer is taken as an example.The original data screenshots are as follows:Problems encountered:1. For the first attempt, the “Build Internal Edges (Advanced)” parameter in AreaBuilder is set to Yes, and “Snapping Type: Vertex Snapping && Snapping Tolerance: 0.01e” is set. Although all the Features are not lost, there are still some features ,which was no build, and some area with duplicate edges !Why is the "Build Internal Edges (Advanced)" parameter set, but it does not work? Why some area with duplicate edges ? 2. For the second attempt, use GeometryCoercer/TopologyBuilder to convert all the areas into lines, then overlap all the lines, then build the areas with AreaBuilder. The results show that some features in the OutputPort of AreaBuilder are missing, as shown in the
I've got around 15,000 route line features I've generated from a ShortestPathFinder and want to combine these into one feature. Every line overlaps every line as the routes were from lots of addresses to one place. I've tried using a LineonLineOverlayer which works perfectly on smaller datasets but here the merging is taking days.I'm sure there's some clever way of splitting my dataset up and speeding up this process, or maybe there's an entirely different approach to doing this, or maybe even the ShortestPathFinder can be configured to output all routes as one feature?Appreciate any suggestions , Thanks!
How to upload a shapefile or geotiff to geoserver with FME
Hello,i'm trying to solve a problem with AUTOCAD dynamic blocks. I'm looking for the original name when they come with "*Uxxx" name.I created an invisible attribute "HIDENAME", defined as "constant" in each block definition (Autocad user's must not see it). The value of this attribute matches the original name.I don't see this attribute in FME Data inspector ...(ps : I don't want to explode blocks to solve the problem)
I have a point featureclass and a geodatabase table which I have joined using SQL Creator. When I add an inspector and run the workbench, I cannot see any geometries from the featureclass which I have joined in SQL creator. Here is the query written in SQL creator.select a.FCGLOBALID,a.FEATURECLASS, a.OPERATION, a.PROCESSSTATUS,a.MXASSETNUM, b.ADDRESS, b.CITYNAME,b.DIVISION,b.FACILITYID, b.GISSYSTEMTYPE,b.GLOBALID, b.MXASSETNUM,b.MXCREATIONSTATE,b.MXSITEID,b.OPCENTER,b.PATROLNUMBER,b.SERVICENUMBER,b.STATENAME,b.STATUS,b.STREETADDRESS,b.STYLEDEFAULT,b.TOWNGASNAME,b.ZIPCODE, b.shapefrom arceam.pub_to_p_delta a left join arceam.p_metersetting bon a.FCGLOBALID = b.GLOBALIDwhere a.PROCESSSTATUS='N' and a.FEATURECLASS='P_METERSETTING'This query work fine in sql developer but when I run the workbench, the execution is successful but I get following errorsBADNEWS: File C:\apps\FME\metafile\oracle_spatialDef.fmi could not be opened (tabrdr_classic.cpp:2756 - tabrdr::ClassicTableReader::TableRea
Hi, I just started working with JSON files and could use some help with a specific workflow. I have a list of addresses stored as JSON where I want to remove certain objects/arrays that match with IDs from a reference list. In the attached example I want to remove the address with the ID 1 from the JSON file. The workspace already works but I'm sure there must be a more elegant solution for what I am trying to to. In my approach I expose the IDs with a ListExploder remove unwanted IDs via FeatureJoiner and then I reassamble the original JSON with a JSONTemplater/Aggregator/AttributeManager. It does the job but its not pretty. I already checked the very informative JSON tutorial but I could not apply it to my problem. Thanks in advance for any tipps on how to improve my workspace.
Hi There, I am building a workspace that generates point location based on measure using line features, it uses Snipper tools with Measure (Value) as snipping mode (screenshot below). I have two questions:I get this error in one of our datasets, where it shows a warning and FME just hangs. It seems like an issue with generating last point where measure is same as the highest value. I am not sure if this a data precision related issue or a Snipper transformer issue. 2019-04-24 09:43:22| 158.4| 1.7|WARN |@Snip (or FMELine::snip) was given Measures of 49447.77 and 49447.77, which are out of range for a line with min/max measures of 0 and 49447.77. Snapping params to closest valid value.2. How can I make sure that process proceed with remaining data and skips the record that has problems.Appreciate any input. ThanksJay
I have around 35 gml-files, all with many attributes (25 attributes per xml). I am writing the files to an Oracle ArcSDE database. How can I find and set the best attribute type?In the writer all attributes are set to: type char | width 200 or 2048.Some of these attribute are dates or integers. Somehow FME is not defining the correct attribute type. Can this be done? Other attributes are indeed char but not with a width of 200 or 2048. Is there a way to find the string length for all attributes in once?I could set a StringLengthCalculator for each attribute, but that is an enormous amount of work.
Very new to the FME world.If I have a DWG file that looks like this?What is the workflow to have the buildings and shadows look like this?Let's leave aside the road names and railway tracks for the moment and focus on the look of the buildings.
Hi @takashi, do you have any ideas on how I would isoloate this first line of text in each 'cluster' of text? I have about 3000 to isolate.....The cluster formats are all the same but the first line of text varies in length.This information is stored in a text file at the moment and each clusters is separated by 1 character return.WGS84-YORK_LANDING-CZACDESC_NM WGS84 YORK_LANDING CZACDT_NAME WGS84PROJ LMUNIT INCH WGS84-CASTLEGAR_-CCT3DESC_NM WGS84 CASTLEGAR_ CCT3DT_NAME WGS84PROJ LMUNIT INCH
This is my web page:http://solutions.arcgis.com/water/help/water-utility-network-configuration/DataDictionary/DataDictionary/I want to extract the text value of <div class = "agOverview agDetails spacing "> and the transformer finds the class but for some reason any Tag Part/HTML Attribute I use that's on the Property page of Google Inspector results to null. I also tried the drop down options (Whole/Value), tag #text and the result for the transformer is a feature with null value. Any ideas?
Hi,This is a bit hard to explain so I hope this drawing shows what I want. I am trying to create a gml spesification where different geometry segments in a polygon feature is split into curvemembers only containing one geometry type. Basically when you have a boundary of line segments and arc segments, the gml will wrap a curvmember around every geometry type segment. as illustrated.I am using a GMLFeatureComposer so I have the ability to update each gml feature before writing it out with a text file writer. Should I use xmlupdator, or is it possible to do anything with the native geometry structure of IFMEPOLYGON to contain multiple IFMEPATH segments?