Using transformers to modify data.
Recently active
I have a process were I need to create a downloadable zip file that contains a file that has an odd extension. So far I am able to create the folder, but the file copy writer is renaming the folder instead of making it a file with odd ext. I have added a picture to show how the folder displaying how the folder got renamed instead of changing the extension and making it a file.Thanks in advance for any feedback.
Hi.I'm working with a dynamic workflow. I have an ArcSDE reader and in some of my tables (I don't know which ones) I have a date (1899-12-30) that I need to set to null.My idea was to first filter the attributes with a date format, then filter the values and finally set the value to null.I know how to do it with one table because I know which attributes are set to date format. But with a dynamic worflow, how can I detect date attributes in all tables of my ArcSDE DB ?
So I want to delete the duplicates, or find the distinct combinations across two columns.I know I can do that with SQL on a database. But I just have a table here and want to do that directly in my FME script. Does someone has an idea?
I use XMLtemplater to design my XML file from Excel, but i have problem with the result:This result, it coincides with each output data field: I want to group like this:And this is my model FME:Anybody help me, pls !in my excel file, the fields "table_id" in sheet "table" and "table_id_field" in sheet "fields" are key fields to link these two data tables together
Hi,I'm downloading a bunch of text files from an FTP server and the contents of each file is stored in an attribute. The format of a text file is as follows : Station1;2022-04-12;09:00;Var1;True;30.4;Var2;True;0.5;Var3;False;0.0;Station2;2022-04-12;08:00;Var1;True;33.4;Var2;True;0.5;Var4;True;10.3;Station3;2022-04-12;09:00;Var1;True;27.4;Var3;True;0.5; What I would like to do is transform this text to a table as in the attached screenshot, but I have not found any easy way to do it in FME. Would you have any suggestions? Thanks!
I'm upgrading from 2016.1.3.2 to 2021.2.5.I have geometry stored in PostGIS -> GeometryReplacer converting from Hex OGC WKB -> optional Reprojector -> Shapefile or FileGDB (both types). According to the log files, for 2016, there's barely mention of GeometryReplacer and Reprojector, but for 2021, there's a significant chunk of runtime devoted to passing through the two transformers. There's minimal changes to make for them to upgrade so it's bizarre why it's adding nearly double the runtime. (See log attachments) For production concerns, jobs are taking several more hours to run. Here's metrics for another dataset:2016:2021: Thanks,Janet
I am trying to covert geotagged photos from a mobile phone and convert them into a KMZ file, every works great except the actual photos are not being inserted into the KMZ file... How do I fix this?
I have added an extra column in the shapefile using attribute manager. How can I edit the values in that column?
Hi!In the translation log, i have tried to add a specific row (in my case row 85) to attribute table without any result. Is this possible to do it? The pythoncaller script (Esri Arcgis Python 3.7) look like this: import fmeimport fmeobjectsfrom arcgis.gis import GISfrom arcgis.apps.storymap.story import StoryMapfrom arcgis.apps.storymap.story_content import Image, TextStyles, Video, Audio, Embed, Map, Text, Button, Gallery, Swipe, Sidecar, Timelinefrom arcgis.gis import Itemfrom arcgis.apps.storymap import Themes class FeatureProcessor(object): def __init__(self): pass def input(self, feature): gis = GIS("home") new_story = StoryMap("9f1567e92c514baabdc2e595776bfdc8") new_story new_story.nodes newFeature = fmeobjects.FMEFeature() self.pyoutput(newFeature) print(new_story.nodes) def close(self): pass def process_group(self): pass arcgis package 2.0.0 in ArcGIS Pro needed to run this script. A similar script without arcgis package 2.0
I am trying to create features out of a large json file that has many objects mixed in with arrays. I can almost get what I need by using the following query:json["Domain"]["Classifications"][*]Unfortunately, it leaves out a crucial attribute. Here is a screenshot of the json file where it has me stumped:Here is a link to the entire file.The attribute underlined in red is what I am looking for. There are hundreds of them at this level, all differently named. I have not yet found an example of this schema type, with hashes within a hash. In addition, the schema is not uniform. I can get to where it will separate the "Psets" attribute into features, but the "IfcActuator" level does not come through unless it is all in one big feature. Here are some screen shots of what I mean:This is the result of: json["Domain"]["Classifications"][*] Add one more wildcard [*], and you get this:What syntax/language should be used to quer
This is less a question and more of a finding to report. In 2016, File Geodb Open API treats date values "1901-01-01" as "19000101000000", but in 2021.2.5, the reader treats the same value as "000000". The effect is the record gets thrown out, despite the writer saying all features are written.We've had to build in a StringReplacer to find all the "000000" to replace with the original date value.Is this a bug? Update:Affects "1900-01-01" as well.
Hi, I have loads of vertices that belongs to polygons and want to change the start vertex so that the polygon always start and ends in the lower left corner. The order of the vertices must stay in the same order so its possible to rebuild the polygon. Spatial sorting works to identifiy which vertex that should be the start vertex but messes up the order of the other. Thanks
Hi, I have a 3D modell as object file. I will convert this to cesium tiles!I tried this way:Reader -> CoordinateSystemSetter -> Writer (Cesium 3D Tiles) But if I import the tiles inside cesium (e.g. cesium ion) I do not get georeferencing. So the model is not display at the correct location. Is it possbile to assign a georeference to an obj file?
Hello Sir / Madam, So I would like to subtract both "Top Height" and "Rooflevel" attributes. I use attribute manager to calculate the value@round(@abs(@Value(TopHeight)-@Value(ROOFLEVEL)),1) The result is shown as below.However, I want my result to be <null> if either TopHeight or Rooflevel is <null>. May I ask how to do it? Thank you. Zachary
I can see the imagery on the inspector but don't see anything in the GDB package that would hold the imagery. The GDB package has ATX, GDBINDEXES, GDBTABLE, GDBTABLX and SPX files.
I am reading a record from a SDE geodatabase and using that record to create a new record. What is happening though is that it is just overwriting the old record. I need to have two records at the end. I select it based on an id and essentially need to make a copy of the record and then overwrite some of the values. Any idea of how I can do that?
I know that the SharePoint List reader and the SharePointOnline connector are quite different from each other. Using a registered app on Azure worked fine for the SharePointOnline connector and its attached web service - but for the list reader, the web connection only required us to exchange the [TENANT] with our sharepoint tenant without changing anything else. This was working fine on our testing SharePoint platform using a non-personal user account to logon with. However, on our actual SharePoint platform, this trick does not work when using my own user credentials (it notifies me that the app needs admin rights) - and I am asking myself why. Does the user need to have certain rights in order to use the web connection? Then, as a second attempt, I followed the workflow here https://community.safe.com/s/article/How-to-create-a-Sharepoint-Web-Connection and it let me successfully test the connection as we have a registered app on Azure. But this failed when I tried to actually use th
I would like to see if a value from a specified column/attribute can be counted into another column based on how many times it appears across multiple columns. I hope to do this for every feature/row of a dataset. Example of the data below : In this case, I would like specify the value in the DominantValue field, and I would like to see how many times this value appears in fields: AreaCount1, AreaCount2, AreaCount3, AreaCount4, Areacount5, and AreaCount6. The number of times it appears would be stored in a field called dvcounter. For example the desired output would look something like the below table: Does anyone have any recommendations as to what transformers or workflows can provide this "count" field? I've attached a portion of the csv data that I am working with and the workspace that I am working on. This workflow builds on top of question that was recently answered by @Takashi Iijima :https://community.safe.com/s/feed/0D54Q00009RcXusSAF
Hello, newbie here. I'm using AttributeManager to rename and remove some Attributes - and to add a new Attribute using a Conditional Value based upon (among others) an Attribute named IATA, which contains airport call letters. For San Francisco International Airport, IATA contains "SFO" but for Nadi International Airport, the IATA Attribute contains "NAN". No matter how I try to force FME to treat those call letters as a string, it eventually becomes "if NAN != null... and I get "nan" as the result. Pretty sure that's a bug (2019.2). Note: Set Value with @Value(IATA) works fine with "NAN". It seems to be only the Conditional Value code that has the problem. Does anyone have an idea how to conditionally process an Attribute that may contain the value "NAN" (or other values that might also be mathematical constants)?
I think this is an easy one, however i am stumped. I have a set of data with 3 columns. Fieldname, Fieldval, RecordGroup. I simply want to aggregate by recordgroup and then rename attribute names to the value that is stored in the Fieldname. Where i am stumbling is how to rename the fields to the values in the input field. Thanks in advance.
Currently, we have a very curious problem. A workspace is made in FME Workbench desktop which runs without any problem. In the workspace, geometry in a ESRI file geodatabase is repaired by a Python script (arcpy). However, when deployed on FME Server, this process results in an unexpected error, see attached file. The account which starts and runs the process on FME server has sufficient read and write persmissions on the location where the geodatabase is stored. What could be the cause of this problem? Kind regards,Pim van der Zwaag.
Hi,Does anybody have any experience writing GDB metadata images into SDE?I can update just about anything but inserting an image to the item description needs to be in a specific ESRI binary format (EsriPropertyType="PictureX") and the AttributeFileReader transformer does not support this encoding type. Cheers, Itay
I'm using an ArcGIS Feature reader to read a layer with two tables. The two tables have 9257 and 9606 rows. After reading the two tables, I join them. At this point (with feature caching) I can see that I have 9606 rows. This is correct. The last step of the workspace is to use an ArcGIS Feature writer to populate a different layer. The ArcGIS Feature Writer has the following Parameters for Layer: Writer Mode: Insert Truncate First: Yes Currently, my destination Feature layer has 10584 rows. How could this be? How can I exceed the number of rows in my source layer? I just ran the workspace up to the Writer and can see 9606 items going into the Feature Writer. then, I ran the entire workspace and the destination layer now has 9752 rows. I'm perplexed. This is a public facing dashboard and I need accuracy. I do run this workspace from a batch file and schedule it to run at 3:00 AM with Windows Task Scheduler. I'm not sure if that matters. Any ideas? I suspect that the destin
In what way can I control the behaviour of SqlExecutor concerning transactions. I'd like to perform several inserts and updates as a single transaction (by putting the "commit"-command at the end). But this commit always results in the warning "there is no transaction in progress".Database = PostgreSQL