Using transformers to modify data.
Recently active
My inputs and outputs are the same, but the LineOnLineOverlayer is significantly slower than the Intersector. Why does the same process takes longer in one vs. the other? Is the Intersector preferable over the LineOnLineOverlayer?
How do you create a JSON connection that has a API key?
Hi, I have an address dataset with the usual errors like abbreviated streetnames (str instead of street, ln instead of lanes, bd instead of boulevard) etc.I want these written out, and by using regular expressions with individual stringreplacers I can get this to work. However, I want just one stringreplacer to do the job. When I try this, I get empty values for the streetname attribute, so I think my parameters must not be filled in correctly, or I messed up the syntax on the regular expressions maybe.Where do I set my conditions? In the "Text to replace" field, or in the "replacement text" field?Right now, one of my conditions is:test condition:IF: @Value(street) CONTAINS_REGEX str$Output Value:streetI've tried numerous ways, using reg expresions as output value, or using string functions, none worked.Can I get a clear example from someone?
I am trying to create a workflow to normalize a table with potentially thousands of columns while maintaining the id column. This would be an easy solution if the AttributeExploder allowed you to specify a column (or columns) to keep unexploded. Since this transformer does not allow this, a workaround I have come up with is to use the AttributeExploder with the option in the transformer to "keep all attributes" and then use an attribute keeper transformer to keep the "id", "_attr_name","_attr_value" columns. This would generally solve the problem but since there is thousands of columns, if we use the "keep all attributes" option in the AttributeExploder the workbench performs exponentially slower to complete (it will go from taking 2 hours to complete, to 40 hours to complete). Is there potential workaround which can solve this problem within a more reasonable processing time?
Hi all,I have ~50 oracle DBs. Each of them has instance name and the tnsnames.ora file is set up on the local machine. There is one same table in each of these DBs that I want to do a simple count on.What is the best way to iterate thru all these DBs without the need to set up 50 or so readers?Any input will be appreciated.
Hello,I have created an API call with a .json file, however, I am struggling to process these attributes (after having used JSON Flattener), I think it should be easy but I cannot get it.Attached the image, I would like to have the list of attribute that appears on the right side as a proper table in which each row means a different element.Could anyone please help with this? Thank you very much
Hi,I have just updated Data Interoperability to 2017.1 and have noticed the DateFormatter transformer has been removed with no sign of either of the new DateTime transformers...any ideas how I can get the new transformers? Or at least get back the DateFormatter? Thanks
Good morning i have been having a perplexing issue when writing a date to tab and shape. (FME 2015.1.1.0 build 15515, date formatter version 3)From my source data my date is coming though as a string YYYYMMDDHHSSSSSS and using the date formatter it’s a simple matter to turn the date into YYYY-MM-DD.I check It is changing the date correcting via an inspector on the formatter and it is writing correctly.The issue is that when I write to a shape or tab output with the field type to set to date the data will not write correctly, Ie I get a null attribute.If I write the date YYYYMMDD then the attribute is written correctly.If I change the shape table field type to char then the YYYY-MM-DD then the date is written correctly. This is very perplexing…CheersQ
I have a problem with PointOnArea overlayer transformer and it is getting very frustrating.I have three different point layers with different attributes and one polygon layer as input. Using the transformer, I noticed that one attribute appears to have no values, thus I assume it was dropped during the process.I already tried to delet and reintegrate the transformer, furthermore I applied the list exploder transformer. No success!What is going on here? Did anyone face the same problems and can suggest another approach? Thanks,Leona
I have numerous individual lines that do not share nodes or endpoints. I want to aggregate all into one object. So far, I have tried unsuccessfully with TopologyBuilder, LineJoinerThis is the equivalent of ArcGIS Dissolve (Lines) - Allow Multi-part featureInput: Many line objects Output: Single object
Hi,I installed FME 2018 RC1 for testing new transformers.I noticed that FME did crash quite often when I opened a workspace I'm currently working on in FME 2017. But after some attempts FME would finally open the WS and I could modify and run it without any issues.Today I cannot open the workspace at all - I tried more then 10times either using Explorer context menu ("Edit with...."), "Open Workspace" dialog in FME, Drag and Drop WS onto FME canvas.I get the message: FME has stopped working. Close or Debug. No further details why the crash happens. The WS has been saved with FME 2018.I'm able to open the WS with FME 2017 but as it contains new transformers cant be run anymore in there. The WS uses File GeoDB reader and writer.I installed 32bit version. I also installed on second machine but get the same error there as well.Any ideas?Thank you, Rob
We are observing issues while trying to insert the Annotation Text along with the Leader/Dimension lines, into an Annotation Class in a FGDB. The Annotation Text and the Leader/Dimension lines are separate components in source FFS files. The annotations are getting inserted properly but linear features getting inserted with all Null attributes and getting represented as an image in ArcMap. Please suggest.
Hello,I have a quick question. I'm joining lines together based on their nearest point, however not all lines have vertices and as a result the line will not extend. Why is this? I would think there would be a starting and ending node. See image below. (red and blue dots are vertices. Arrow pointing to where vertices do not exist.) Is there a way to add a point to the end/start of a line? Densifier transformer did not seem to work.Thanks,David
I am dealing with TomTom data. I am updating the zip code information from a more reliable source. The reliable zip code source does not contain Left or Right for zipcode, it is instead just polygon boundaries with one zipcode. My issue is trying to figure out which side of the road these boundaries are on (Left or Right) and then applying that result to the TomTom road data as ZipCode_L or R. The images below show a zoomed out shot of my data and a zoomed in shot with the Road circled that this situation would pertain to. Red outlines are the Zip code boundaries and the Lime Green lines are the Roads.
Hi everyone,Two point datasets of drill hole locations are obtained from different sources and are of different age.Both excel tabular datasets read in correctly and use the same projection but do not have a common joining field / key. In some cases a "holename" text string field in each dataset is very close to a string match, but often due to naming convention or case changes will not generate a match.I have added a "source" attribute to each dataset upstream so I can trace the origin.Several versions of spatial joins have been tried using either neighbour finder or point-on-point overlayer to attempt to;1) Identify potential duplicates based on proximity2) If duplicates are identified (and confirmed by eyeball that the holename is similar), check which of the points has the latest age , and use the geometry of the latest in a consolidated single point dataset.Each of the neighbour finder and point on point overlay seem to have pro's and con's in this appl
I'am inspecting a kmz-file. As I do i get an error that reads like this: XML Reader mapped feature # 110000The primitive geometry type 'lines' is not supported by the Collada readerAn error occurred while constructing the geometry with id 'ID150892'A '<vertices>' element was found which did not contain a '<input>' elementA fatal error has occurred. Check the logfile above for detailsClosing the Collada readerKML: No model data read from referenced file `models/untitled.dae'I am not entirely sure what it means or how to rectify it. The .kmz-file can be read by google earth without any major hickups. So:What does it mean?How can I fix it?
I want to tile Buffered line feature and after that want to dissolve it. But the tiler tile only the total boundary. And do not provide any features into the tiled box. Need some suggestion.
Hi folks- I have a polyline file (in planar coordinates) and attempting to build a 200ft buffer around each line. Simple, but I am repeatedly getting the error: Cannot write a non-area feature to an area feature class. The bufferer seems to be writing out polygons...fme_geometry is showing polygon. I've tried geometrycoercer, attribute exposer, geometry validator...all successful in saying the polygon geometry is legit. I can even write successfully as a polygon shapefile. But not to a fGDB polygon feature class.
Hello,I'm looking for a way to capitalize the first letter of a string but leave the rest of the string untouched. I have tried the StringCaseChanger, but that didn't seem to yield the result I was looking for. Have Want de Gouden Draak De Gouden Draak het Rijksmuseum Het Rijksmuseum paleis op de Dam Paleis op de DamThanks,Ed
I have a set of polygons which has been clipped at one point in time. I would like to dissolve them back together but only along the path originally used to clip them. I don't want to dissolve all polygons touching each other. My approach so far has been to locate the edges of the polygons I would like to remove and I have marked those in the image below (I have the markings as features). I don't have a common ID on the polygons I would like to dissolve, so I haven't found a way to group the polygons to dissolve them in that way, since one polygon might have more than one marker attached. How can I achieve what I have outlined below?Reference:
Hello, I have several publications in FME Server that are monitoring for incoming emails. The publications are subscribed to different topics. I am making a master log (in SQL) of all incoming emails for all the topics. When I start the monitor for a topic in FME Server, I get this sample JSON notification output:{ "email_publisher_subject": "[this is the subject]", "email_publisher_sent": "Fri Jun 30 14:41:19 EDT 2017", "email_publisher_content_type{1}": "text/html; charset=\\"iso-8859-1\\"", "email_publisher_from": "testemail@gmail.ca", "email_publisher_content_type{0}": "text/plain; charset=\\"iso-8859-1\\"", "ws_topic": "Document_Incoming (EMAIL)", "email_publisher_received": "Fri Jun 30 14:41:32 EDT 2017", "email_publisher_to": "destination_email@gmail.ca", "email_publisher_content{0}": "[
Pretty simple question here. I know that you can read zipped shape files by simple changing the extension to .zip in the advanced file browser. However, I tried this with .gz and had no success. Is there another way I can do this? I’m using FME 2015 32x. Regards,
I have a set of dynamically segmented lines, from a dynamic segmentation workspace I set up. The problem is, I have so far over 2 million dynamic segments, and I would like to extract measure values (Beg_measure, and end_measure) for each of these dynamically segmented sections. These dynamic segments are generated by overlaying (using a lineonareaoverlayer) a bunch of environmental data on a set of lines (Rivers, land_types ETC) and the lines are segmented at each point where the data changes. The source linear dataset has measures on them, but I'm having trouble generating the measures for the dynamic segments. Any suggestions or contributions are welcome. Thanks in advance for your help.
Hello,I am new to FME, and I am trying to understand a script made by someone before me. The major issue I have right now, is that the result from an extrusion (originally from shp files) is creating objects with several faces, for both in and out normals : It looks like this :The process leading me to this looks like this :Of course, I would like to get rid of the inner faces, any ideas on how to do this ?Thanks in advance
Hello,I am working on a workflow that extracts GEO data from an ESRI GEO database to a GEOJson file that has to be imported into Socrata. The issue I encounter is that my (in FME generated) GEOJson file apparently doesn't apply to the GEOJson standards.Checking this file on geojsonlint.com I mostly get errors that features don't follow the right-hand-rule or GEOJson structure errors. (type member required)Importing this GEOJson file into Socrata goes wrong. (But when I import the GEOJson into QGiss and save it again as GEOJson there is no issue importing this into Socrata.) I've been debugging and testing for a while now but can't figure out what I'm doing wrong. I can only think about 2 things. Am I using the Orientor correctly?I use the OrientationExtractor to determine the orientation. Then I use a Tester to get only the left-hand-ruled features. With a the Orientor I convert these left-hand-ruled features to right-hand-ruled ones. Settings of the Orientor are: O