Using transformers to modify data.
Recently active
Within Sophos can exclude event id but as file locations for each transformer is different would have to keep adding them. Command used to install like below. Have excluded paths with no success. Is it possible to install transformers from command line rather than within FME application. Tried to use below command but file not found. Manual install may get round Sophos blocking . Thanks in advance for any advice supplied. pip install --force-reinstall --no-deps --no-index --find-links C:\\Users\\test\\AppData\\Roaming\\Safe Software\\FME\\Packages\\22800-win64\\PackageFiles\\safe.s3connector\\python --target C:\\Users\\test\\AppData\\Roaming\\Safe Software\\FME\\Packages\\22800-win64\\python\\safe.s3connector --upgrade --no-compile fme-amazons3'
I'm working in an Oracle database, where there are multiple duplications of features with matching geometry that shouldn't be in a table named "TDS71"."METADATASRF". There are millions of records, and I haven't found a native FME transformer that can handle this in a timely manner (Matcher, AreaOnAreaOverlayer, etc). So I'm experimenting with deleting the duplicates in SQLCreator. For now, I'm simply just trying to return all but 1 of the duplicated geometries, and will worry about deleting after I can identify them. The code below is returning many more features than expected. I'm not really sure why to be honest. For example, a feature is duplicated 6 times in the database. From the query I have currently, 15 records are returned. Does anyone have experience doing this in SQLCreator/Executor?select a.OBJECTID, a.SHAPEfrom "TDS71"."METADATASRF" a join "TDS71"."METADATASRF" bon sdo_relate(a.SHAPE, b.SHAPE, 'mask=equal') = 'TRUE'and a.OBJECTID < b.OBJECTID
Hi folks, While working with some JSON data, I seem to have noticed that null values are sometimes interpreted as a literal string, instead of a true <null> value (like non-existent/empty). When I just tried to replicate this, it seems that different FME JSON transformers seem to handle null values in a different manner. E.g. when using a JSONFragmenter or a JSONFlattener, it seems that null values are indeed recognized as true <null> values (like non-existent/empty), but when using a JSONExtractor or an XMLXQueryExtractor (with a JSONiq query), it seems that null values are returned as a literal string. Of course in the latter case I could add a NullAttributeMapper transformer to change the literal string 'null' to the <null> value, but this seems like a bit of a workaround (and also, how would you then distinguish between a literal string value "null" in JSON, and the true null value) Is there something I'm missing, or is this a bit of a bug? K
PDF2TextReader does not recognize my published parameter for selecting a pdf file into the transformer. Is there any workaround this? PDF2TextReader runs when I select the pdf file directly but not when I use a parameter in selecting it.
It looks like Deployment Parameters might make some of our processes more manageable. Is it intended for use with workspace runners? Is there any documentation out yet for this new feature?
I have a table of values with ID, Start, and End. Starting with the first row, I need to select the next row where the start value equals the end value of the first row. I need to repeat this process for the entire table. For example, I'd select row 1 then row 4 then row 6 then row 9 then row 13...Any thoughts on how to do this?
I have this GML dataset (https://service.pdok.nl/hwh/administratieve-eenheden/waterschapsgrenzen/atom/downloads/administrativeunit.gml). I tried all kinds of configurations with the different GML readers (although I expect the INSPIRE GML reader to be ready for it). I can't get it to work. I also don't have much knowledge of the ATOM standard. Any directions for help?
I have an intermittent problem where an FMEServerJobWaiter fails to wait for a job to complete and rejects it after 30 mins-or-so when in fact the job is still running and completes successfully (it gets rejected with a 502 gateway error).Is there a difference in the way the FMEServerJobWaiter works compared to the Wait for Jobs to Complete parameter in the FMEServerJobSubmitter? - might that give more reliable performance?Using FME2021.2.
Greetings, I am trying to replace values using the AttributeValueMapper, it is not replacing the attributes in the field I would appreciate any assistance to resolve this issue.
I want to create an Workflow in a Workspace where i load data from a Transformer and then create an Folder with the Name of the Attributevalue and then write the other Data in an Excel file in the created folder. To Create the folder with PythonCaller was easy, but i have no idea how i use the Attribute Value in the Excel writer Destination.
HiI tried to download some data using OSM downloader but I recevid an errorcan ypu help plesae ? thx Francesco
or one reader and several writers? and there are some extra output feature must be derived from open data first.
I have a large polygonal dataset and a point dataset with 178 records. I need to select the polygons that have a point within them, merge the attributes of the two and then write out a polygonal feature class to later be consumed in GIS project inside Arc Pro. I have tried Point On Area Overlay but the output Point data does not contain any attributes from the Polygonal dataset and vice versa. I have also tried Spatial Relator / Spatial Filter with no luck. Any suggestions greatly appreciated!
I have a WMS that I can open in e.g. QGIS. Both the FeatureReader and the OGC WMS reader can show me the different selectable layers in "Properties". But when I start the translation, I get a 404 error saying it cannot be found. This is the WMS I'm trying to read: https://geodata.naturvardsverket.se/planeringsunderlag_o_strategier/wms?layers=Sannolikt_och_potentiell_kontinuitetsskog Why and what can I do about it?
We are using HTTPCaller to batch geocode thousands of records, but we are running into an issue with special characters that are causing the HTTPCaller transformer to fail. As a workaround, we've been using multiple (20+ at this point) String Replacement transformers to catch and modify the special characters before going to HTTPCaller. Geocoding the same input table using the Geocode Table wizard in ArcGIS Pro completes without issue. Are there certain characters that HTTPCaller cannot handle, or is there a better or more robust workaround than using String Replacements? Can anyone offer insight into why the input table geocodes successfully in ArcGIS Pro without any data sanitization/cleansing in ArcGIS Pro, but fails in HTTPCaller? Thanks in advance for any help you can over. @natalie_campos @acueva
I'm currently using a file gdb reader, a statistics calculator to get the total counts, attribute manager to create fields called Today_Count and Yesterday_Count and then the conditional value in attribute manager to try and compare the two counts and return a 1 if they're exactly the same but I can't seem to get the comparison to happen. Also how do I set this up so that if the counts are exactly same I can send out an email notification?
Hello. I have a question please. I have a DWG resource that I need to transform to SVG. I managed to export the geometry, but I don't know how to bind the styles - line weight, transparency, etc. Can someone please advise? Thank you
Can AGOL Feature Service writer be used to write pdfs on AGOL?
Hi! I have an issue with the Clipper-Transformer, that I would like to use for a batch deploy. The clipper input is a Shapefile with about 1.7 Million polygons, defining a grid. The clippee are a few hundred Point Clouds as LAZ, that should be clipped according to the grid. I use batch deploy because otherwise the Point Clouds fill up the disk space and make FME crash. The issue I have with batch deploy is, that the $hapefile (Clipper) is re-read everytime a new clippee is loaded, which is very time consuming. Thanks a lot and with regards, Matthias
So, I have a little issue, that I cannot get to the ground of. Maybe someone can help. So, I have this TIF File, which I am trying to convert into a SHP file. This is how the TIF looks: And this is how my FME Flowchart looks like: But... When I let it run I get a SHP file, yes, but it looks like this: Lots of triangles instead of one solid block. Can someone tell me, what the issue is? What am I doing wrong?
Does the SchemaScanner add an extra character to the fme_varchar(n) attribute?
Greetings,I have a weird issue where the ESRI FGDB writer runs with NO error messages.It writes out to an ESRI Shapefile, but the FGDB has 0 records???This is the FME output Total Features Read 68587=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features Written Summary=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-Hazards_3857_20230613_Geom 11021Hazards_3857_20230613_NoGeom 11021Hazards_3857_Geom 11021============================================================================Total Features Written 33063 The output in the FGDB? Any assistance is appreciated, it is really frustrating.
Hi, I am reading a bunch of asci files and use a raster mosaicker and trying to write to a raster or mosaic dataset.I have trued seting creating new attributes geodb_raster_path set to fme_dataset and geodb_raster_type to 'Raster'. or 'Raster Catalog'I am getting error message: The raster type 'Raster Catalog' for mosaic dataset 'zzDataset' is not supported by the installed ArcGIS version
Hello. I would like to ask. I have a workspace where, see the attachment, I have set a time filter (red frames). I would like to store various dates in this format in the database, for example the date for each specific month. Each cycle, a new date from the database would be automatically replaced by this filter based on the number of validly executed workspaces. Can this be solved somehow? I would probably solve the individual cycles with some kind of "counter" transformer, it will be more complicated to insert the date. Go in the direction of some parameterization? How do I ensure that the correct date is always set on the test filter? Thank you very much
I am doing the completion date subtracted by number amount(200 days) using Subtract Interval or Interval between dates using the completion date - DateTimeNow. the FME rejection code is INVALID_INPUT. Any suggestions is greatly appreciated