Using transformers to modify data.
Recently active
I process CAD files that have the same information in them but the information is formatted differently.I need to find each iteration and process acordingly.I am trying to split an attribute with AttributeSplitter. I have also tried the fmehub RegxAttributeSplitter. (A-[0-9]+ )The problem I have is that in one case the string will split with \\n but in another there is no line break. (as far as i can tell the autocad text box is set to a specific width and the text just rolls to the next line with no break or even a space.)So if I split on lf on one dataset it works. but on another data set it just puts the entire string in with no space. are there any suggestions as to how to accomplish this?
I had a minor task of buffering just over 70 000 points in lat-long by half a meter. I thought I would try the new parameters on the Bufferer instead of using the GeographicBufferer and the performance was very disappointing. Has anyone else experienced this?I decided to run a few tests with the same data and the results were as follows. Reader -> Bufferer [Buffer Distance: 5e-6, Buffer Distance Units: Ground Units (None)] runtime: 38.9s Reader -> Bufferer [Buffer Distance: 0.5, Buffer Distance Units: Meters] runtime: 4h 16m Reader -> GeographicBufferer [Buffer Distance: 0.5] runtime: 2min 0.5s Reader -> CommonLocalReprojector[_AZMED_] -> Bufferer [Buffer Distance: 0.5, Buffer Distance Units: Ground Units (None)] -> Reprojector [LL-WGS84] runtime: 49.8s Reader -> Reprojector[_AZMED_] -> Bufferer [Buffer Distance: 0.5, Buffer Distance Units: Ground Units (None)] -> Reprojector [LL-WGS84] runtime: Error, apparently bad things happen with the Reprojector
I have a huge Geopackage where the included tables have foreign names. I would like to rename these tables to something more intuitive so that the data gets easier for me to work with. There is a external text file with translations that I would like to use. I guess there are two ways to do this: Either run a workspace and save a new geopackage with the "new" table names, or rename when opening the file. Both methods are fine by me. How do I rename the tables?
I have been able to connect with FME directly to the PostgreSQL database that holds the ArcGIS Portal host feature services. The features are stored as tables with a "shape" field holding the geometry. However, I can't figure out how to convert that shape field, which is labelled "st_geometry" into actual geometry. FME writes it to the data inspector as a text, for example, 280000000100000001000400E193040010000000010000009587C3B5B486AD0380BFE7BF9590AC13. Thanks for your help.
Hi,is it a bug, that whitespace is removed in the next step (Parameter Fetcher) in the AttributeConcatenator? In the userparameters the space is still their and the parameter is not checked.
I have an Excel sheet that looks like this:I would like to be able to write out data to the table outlined in red.However, I do not know how many rows of data I will be writing out before I run the workbench. Sometimes it will be two rows of data, other times it will be 7000+ rows of data. In the instance that it will be more than the 7 rows that already exist in the template, I would like the table to expand so that I keep my formatting and I don't write over the data and tables that exist below. I have tried using named ranges as outlined here but I have not been successful at even getting it to write to the correct spot that way. Currently, these are the parameters for the Excel Writer that I have:But this will only start it writing out in the correct spot and then overwrite the rest of the sheet when there are more than 7 rows of records:I currently have a work around where my template has 10000 extra blank rows in the table and then I run an Excel macro to delete all the extra
I am working with a roads dataset, and need to assign what is primary and what is secondary for each line segment. I have the line segments in a single feature class. Each segment has a Unique ID, a routeID, then the mile marker for the start and endpoint of the line. What I need to do is compare the mile markers for each line segment that share a routeID. The end goal (as illustrated in the attached image) is to eliminate areas of overlap (which will be marked secondary). I plan to accomplish this by seeing where the mile marker endpoint of one segment falls within the range of another segment that shares a routeid. So in the example attached, the segment that stretches from 5-7 would be marked as an overlap because endpoint 5 falls within the segment that stretches 0-6. Thanks!
I am trying to follow the documentation listed here https://community.safe.com/s/article/json-transformations about making an HTTP call, flattening the JSON with JSONFlattener, and then pulling out the attributes with AttributeExposer. The flattener even seems to show the flattened JSON feature information. But when I connect that to the attribute exposer, it seems like I can't choose anything out of the JSONFlattener as my attribute to expose in the attribute exposer. Importing isn't any better. It doesn't automatically find the features for me, and the import options seem to be only documents or URLs. A URL pointing at the API would work for this example, but not if I wanted to use an API with more stringent access policy. Am I missing a transformer or a JSON query in between the flattener and the Attribute Exposer? Is there a better workaround here?
I have a CSV file of attributes that I want to assign to a new CSV file and have been trying to use the FeatureMerger to assign the original attribute to the new attribute but it doesn't work, any suggestions?
First of all, I agree that IFC is used in many ways, not all IFC's fits together, and not all IFC's are completely "after the book". One way is to give an address and lat / long in IfcSite. But this is only an approximate location, linked to the address point. It has nothing to do with the coordinate system used. By using this, one probably ends up on the right plot, but not with any particular accuracy. Example from a sample file good building-case-project: IFCSite with Address Verification:# 111 = IFCSITE ('01uPthe3Uixx0TRWar3Vt8', # 26, 'Helland', 'Test plot in B \\ X2 \\ 00F8 \\ X0 \\', $, # 108, $, $,. ELEMENT., (59,24,47,484830 ), (9,3,30,811790), 75000., '3817-55 / 40/0/0', # 99); # 99 = IFCPOSTALADDRESS ($, $, $, $, ('Kyrkjevegen 6'), $, $, 'B \\ X2 \\ 00F8 \\ X0 \\ i Telemark', '3800', 'Norge'); But what needs to be taken into account are: # 80 = IFCGEOMETRICREPRESENTATIONCONTEXT ($, 'Model&
Hi, I have a huge data table where some cells have codes (e.g. ND, TR, TC, XX, etc.). This table gets updated all the time, and I read this data, and I want to get rid of these codes and just replace with zero. I have no idea how many codes are out there (a code may not be in the current table but may appear in an updated version). So, I just want to select any cell with a string and replace it zero. How can I do this? Maybe a conditional statement similar to the ISTEXT formula in Excel? Or a wildcard (*)? Thank you :-)
Hi All, I'm looking for advice on how to share/deliver a workspace to another organisation which has a dependency on a linked CustomTransformer and CustomFormat. It's pretty easy in FME Server, just pack it up in to an FME Server project, however, with Desktop the user must first install the dependencies before even opening up the workspace. I'm curious to see how others have approached this task. I know Safe are working on packages, however, they aren't here yet (at least not with FME 2020) CheersMatt
Hello,I have a workbench pulling features from a table in Dynamics CRM, using VertexCreater into a Geodatabase. Everything seems to be working fine, but when I look at the features in ArcGIS Pro, They seem to be in the right place when I zoom to them using the attribute table, but they are oddly not showing. Does anyone know what can be causing this?
Hi I need to extract the building footprints from the LIDAR building data. While I try to extract the polygon, I face some issues. During generalization process building is not coming with the correct angles. please suggest any idea(expecting regularize building in ARC GIS working fine with right angles facility)
I am a student and trying to figure oute how to use las tools for atomaticely detekt edges of houses/building and then draw vektros. In my case I have a point cloud where I already cut off the terrain and stand left with the roof.Are the some nice taransformer or a set up that I can use for this?
Hi everyone and thanks for your timeI've used HullReplacer in order to get my polygon, see attached - but is there a way to place it FLAT at the calculated lowest point of the object.Thank you
Please let me now if you have done this already.
Looking for a single transformer solution on this question. I have an ordered list and I'd like to populate Col 2 (group) with values from Col 1 that start with '# '. Since the number of rows for each group is random and the categories are also dynamic I'd like to avoid hard coding the groups as conditional values.
Hi!I have problems with setting the appearance of multiple geometry instances in FME. For instance: I have N appearances with different names and want to match them with M geometries. The material with the name A(Style name) should match with the geometry with the name A (geometry Name). I cannot figure it out how this is done with the appearance setter. Anyone have an idea? Best regards,Adam
I have a couple of zipfiles in a folder that I basically want to rename. I've used a 'directory and and path' reader to read them in. The name I want to give them is based in the Excel file, and with the featuremerger I add that as an attribute to the file information. However, when using the filecopy writer (either with move or copy as parameter) the name doesn't change. In the translation log, I get the following warning:Ignoring the destination filename 'filename1' because the source dataset 'C:\\edited\\edited\\edited\\GML\\' was not a file. Destination file names are only used when the source dataset is a file' The sourcedataset is set as the folder containing all the files I want to rename, and not one specific file, since I want to rename them all. How can I apply what I want to do? Bonus Question. They are zipfiles, and I would wish to unzip them as well. Can that be established through FME as some sort of batchprocess as well?
Hey FME'ers, For the moment I am updating all my workbenches from Python 2.7 to Python 3.6+. While doing so I encountered a problem with the StatisticsCalculator. Giving me the error: ' ''<' not supported between instances of 'float' and 'str' '.As far as I understand this is because some of the data is numerical where the others are strings. To avoid the error I tried to force all data to a string but that did not do the trick. I suspect this has to do with the fact that Python 3+ uses UTF-8 as default. Note that I only want to calculate the 'Total Count Attribute'.In attachement a simple example of my problem. My workbench version is 2018.1 but I encountered the same problem in FME 2019Any suggestions?Thanks in advance!
If I have a workspace that deals with raster images, is there a way - maybe as a User Parameter - to get the person running the workspace to choose which raster image to use as the input for the workspace? For instance, User A might want to run with a .TIF file, and User B might want to process a .JPG
I'm trying to convert to points from a csv files (it cointains longitude. latitude) but I am getting different results in FME 2018 and FME 2020 version even when the parameters are the same....do yo know what is happening here? FME 2018 is showing the correct projection. Could you help me with this doubt, please? Thanks
Hi FME experts,When reading data into a FME workspace, there is a list attribute in each input feature. Some features have 2 elements in the list and some features have 3 elements. For some reason I only want to keep the first two elements of each list. How can I do that? I searched for the List related transformers, but couldn't find one that can do this List truncation for me. I am using FME Workbench 2018.1 Thank you! Sui
Hi Everyone,I am new to FME and trying to understand basics. Please help in clarifying below doubt. I have a FME Non-Spatial oracle data reader which is pointing to table 'ABC'.And I have another table 'XYZ' with same schema .In my FME workbench "Feature types to read" is set as 'ABC', where as 'Feature types' is set as 'XYZ' I also have Where clause set under 'Advanced', please let me know the difference between "Feature types to read" and 'Feature types' and to which table the where clause points to. Thank you in advance.