Using transformers to modify data.
Recently active
Hi, I am using the translators PhotoCoordinateExtractor to VertexCreator and then writing to a shapefile in order to get points from photos. The problem is that the shapefiles then don't have a spatial reference.Is there any way of getting what the spatial reference / projected coordinate system is from the EXIF information or any FME feature attribute?Or should I just assume that its WGS84?Here are the attributes I know exist, but I dont think any of them can answer my question: exif_brightnessvalue (string) exif_imageuniqueid (string) fme_basename (string) fme_dataset (string) fme_feature_type (string) fme_geometry (string) fme_type (string) jpeg_exif_aperturevalue (string) jpeg_exif_colorspace (string) jpeg_exif_componentsconfiguration (string) jpeg_exif_datetime (string) jpeg_exif_datetimedigitized (string) jpeg_exif_datetimeoriginal (string) jpeg_exif_exifversion (string) jpeg
Hi, I'm trying to evaluate if multiple columns in a single row are populated with values and then count how many columns have a value.For example:COLACOLBCOLCCOLDCOUNT0000042010276210030001571I used the ExpressionEvaluator with the following expression:COUNT = (COLA/COLA)+(COLB/COLB)+(COLC/COLC)+(COLD/COLD)But obviously dividing by 0 is throwing the whole result off. Is there some form of COUNTIF in FME?Are you able to suggest a better solution / fix my expression to ignore dividing by zero?Any help would be greatly appreciated. My brain has decided to give up today...
This SQL works in Toad, plsqlDeveloper, sqlplus etc.. but not FME transformers that accept SQL statements. SELECT permit, mon, quantity FROM isf UNPIVOT (quantity FOR mon IN (jan, feb, mar));I tried this SQL with an Access database, and connections to a non spatial Oracle database. Connections to the data with simple SQL work just fine. Must be that "UNPIVOT" is not supported. Error message is Provider error `(-2147217900) Syntax error in FROM clause. Any help, or workaround is greatly appreciatedlink to example SQL to try in FME: http://www.orafaq.com/wiki/UNPIVOT
I have a road network with streetnames i want to check some gaps in the continuity of the streetnames
I'm attempting the below query in an SQL Creator. I get a "malformed statement" error. How should I format this to run? It works outside of FME... Thanks! SELECTfield1,field2, field3 FROM table1 INNER JOIN table2 ON table1.ID = table2.ID GROUP BY field1,field2
I am very new to FME, so apologies if I'm missing something obvious. . .I am trying to expose the filename of zipped FGDBs in a reader that uses a wildcard (i.e. *.gdb.zip). I want the filename of the zipfile, which is different from the underlying FGDB name in this case. Exposing the name via fme_basename or fme_dataset attributes does reveal everything from the FGDB nicely, but it does not appear to reveal the zipfile filename (which makes sense).So, any ideas how one might expose the zipped file filename when the reader is using a wildcard?Thanks for any help.-Chris
Folks,We have an AutoCAD file that has been treated very badly. Originally it was LatLong projected GIS data but a contractor with no idea about spatial data exported the data as simple CAD coordinates and scaled the CAD by 200K to get into some sort of reasonable scale.We're trying to work out how to transform the CAD back into LatLong. We tried defining a custom projection with a scale of 0.000005 but we're getting errors saying FME can't start the projection engine.In simple terms 1. the drawing is in a known spatially damaged state2. If we could scale the drawing by 0.000005 the drawing would be in a plane expression of LatLong3. We then need to somehow tell FME how to deal with this Sorry for the odd post but we're having a lot of trouble with this.Thanks in advance.
I use the NZTM coordinate system in my file geodbI have a workbench extracting me the center of polygans. The extracted values are in meters.Can someone tell me how to change the coordinates in degree decimal format?Equivalent to the ArcMap, calculate geometry center -> X coord specifying units as degree decimal
HiIs it possible to have xmlxqueryextractor to read from the source of a Sampler.My issue is the source XML file has multiple records therefore I only wish to process them singularly from a sampler of 1st...Cheers
Hi, I have file with starting point in GCS (longitude and latitude values) and all next points are defined as offsets in meters using using Cartesian coordinate system. From those points then I need to build a line(this part is not a problem). I found Offsetter but is seems like it accept GCS only(or whatever Coordinate System the feature is in). What I'm looking is something like Offsetter but with Geographic features (like GeographicBufferer) where you can specify X,Y in meters/miles. Please advice. Regards, Yarko
I'm attempting to extract an AutoCAD Map Object Data table with field definitions. For example the object data table name is "Attribute" and it contains a field named "ATTRIB_ID". I can get the table name with no problem and can write it out. If I use the "Prepend Table Name" & "Seperator Character" params I can produce something like "Attribute.ATTRIB_ID" which appears in the Feature Information pane but I'm unable to expose that value.Any suggestions would be appreciated!Thanks,Brek
I have many xls worksheets where I need to rename some fields as well as create some new fields. I created an xls with the lookup attributes I need as well as what to set the values for the new attributes. Original - Source AttributeNew - New attributeValue - attribute value where this needs to be set.I was able to Import this file and use within the AttributeManager without any issues with both the new and existing attributes mapping correctly. However because I have many spreadsheets that I need to update and the values periodically change for the new attributes I'd like to be able to feed in this table through the Schemamapper. However when I try and do this the attributes successfully rename but the new attributes aren't coming across. I'd like to keep the schema table in one file preferably.Can the schemamapper do this?
I have a large binary raster (1 band, values either 0 or 1) that I want to mask with a polygon shapefile (which contains 1 attribute column, id, with values 0). I was thinking of using Vector on Raster Overlayer for this. However the output file is the original raster, without changes. Am I using the VectorOnRasterOverlayer correctly?
I need to find the top/bottom turningpoint of a dataset - as seen on the image below. these are expressed as x,y,z and possible more attributes. Is there another way than python?
We’re doing nightly imports from various sources into PostgreSQL. Right now we aren’t using FME for these imports, but are in the process of switching to FME. The PostgreSQL tables have fixed “schemas”/table definitions and since there are views using the tables they cannot be recreated. So they are truncated before new data is inserted. The source may for example be an Oracle-table. We import a subset of the columns into a PostgreSQL table. Some column names may change, often we add a sequence and we may also change e g geometry type. There may be other transformations as well. If a column, that is to be imported into the target PostgreSQL-table, gets removed we want the import to fail and the target table to be left untouched. This also if the column isn’t set to mandatory in the PostgreSQL database. So far the only solution I’ve found is using an AttributeValidator to verify that the attribute exists. Without this validator the workflow is carried out without errors and the colum
My inputs and outputs are the same, but the LineOnLineOverlayer is significantly slower than the Intersector. Why does the same process takes longer in one vs. the other? Is the Intersector preferable over the LineOnLineOverlayer?
How do you create a JSON connection that has a API key?
Hi, I have an address dataset with the usual errors like abbreviated streetnames (str instead of street, ln instead of lanes, bd instead of boulevard) etc.I want these written out, and by using regular expressions with individual stringreplacers I can get this to work. However, I want just one stringreplacer to do the job. When I try this, I get empty values for the streetname attribute, so I think my parameters must not be filled in correctly, or I messed up the syntax on the regular expressions maybe.Where do I set my conditions? In the "Text to replace" field, or in the "replacement text" field?Right now, one of my conditions is:test condition:IF: @Value(street) CONTAINS_REGEX str$Output Value:streetI've tried numerous ways, using reg expresions as output value, or using string functions, none worked.Can I get a clear example from someone?
I am trying to create a workflow to normalize a table with potentially thousands of columns while maintaining the id column. This would be an easy solution if the AttributeExploder allowed you to specify a column (or columns) to keep unexploded. Since this transformer does not allow this, a workaround I have come up with is to use the AttributeExploder with the option in the transformer to "keep all attributes" and then use an attribute keeper transformer to keep the "id", "_attr_name","_attr_value" columns. This would generally solve the problem but since there is thousands of columns, if we use the "keep all attributes" option in the AttributeExploder the workbench performs exponentially slower to complete (it will go from taking 2 hours to complete, to 40 hours to complete). Is there potential workaround which can solve this problem within a more reasonable processing time?
Hi all,I have ~50 oracle DBs. Each of them has instance name and the tnsnames.ora file is set up on the local machine. There is one same table in each of these DBs that I want to do a simple count on.What is the best way to iterate thru all these DBs without the need to set up 50 or so readers?Any input will be appreciated.
Hello,I have created an API call with a .json file, however, I am struggling to process these attributes (after having used JSON Flattener), I think it should be easy but I cannot get it.Attached the image, I would like to have the list of attribute that appears on the right side as a proper table in which each row means a different element.Could anyone please help with this? Thank you very much
Hi,I have just updated Data Interoperability to 2017.1 and have noticed the DateFormatter transformer has been removed with no sign of either of the new DateTime transformers...any ideas how I can get the new transformers? Or at least get back the DateFormatter? Thanks
Good morning i have been having a perplexing issue when writing a date to tab and shape. (FME 2015.1.1.0 build 15515, date formatter version 3)From my source data my date is coming though as a string YYYYMMDDHHSSSSSS and using the date formatter it’s a simple matter to turn the date into YYYY-MM-DD.I check It is changing the date correcting via an inspector on the formatter and it is writing correctly.The issue is that when I write to a shape or tab output with the field type to set to date the data will not write correctly, Ie I get a null attribute.If I write the date YYYYMMDD then the attribute is written correctly.If I change the shape table field type to char then the YYYY-MM-DD then the date is written correctly. This is very perplexing…CheersQ
I have a problem with PointOnArea overlayer transformer and it is getting very frustrating.I have three different point layers with different attributes and one polygon layer as input. Using the transformer, I noticed that one attribute appears to have no values, thus I assume it was dropped during the process.I already tried to delet and reintegrate the transformer, furthermore I applied the list exploder transformer. No success!What is going on here? Did anyone face the same problems and can suggest another approach? Thanks,Leona
I have numerous individual lines that do not share nodes or endpoints. I want to aggregate all into one object. So far, I have tried unsuccessfully with TopologyBuilder, LineJoinerThis is the equivalent of ArcGIS Dissolve (Lines) - Allow Multi-part featureInput: Many line objects Output: Single object