Using transformers to modify data.
Recently active
Hello Forum, I notice that when FME Form convert a dataset from one format (e.g.: .tab) to geopackage it adds a field called 'id'. So, two questions: 1) Do geopackage files always have, and have to have, an id field?2) Or is there a way of asking FME Form to not create one/delete it? It doesn’t seem possible via an AttributeManager or in the Writer’s User Attributes. I've noticed that, separately, if I read in the created geopackage I can then use an AttributeManager to remove the id field and then publish again. But there are two problems with this… 1) It's a faff. I'd rather not read in, write out, read in, and write out again. But..2) even after removing the id field via an AttributeManager, the id field always appears in the output geopackage file. This makes me wonder if an id field must always exist in geopackage files. I've also noticed that when creating geojson files FME seems to create a ‘fill’ field and a ‘stroke’ field, which I can't remove. Is
Hello,Has anyone faced issues while trying to read DGN files (V7 or V8) in FME 2022? My current version is FME(R) 2022.2.5.0 (20230329 - Build 22795 - WIN64). Below an screenshot of the error:I have tried to changed the reading parameters but still unable to read it. Also I have loaded the same DGN onto FME 2020 and works fine.Can this be a bug in the 2022 version?
I am trying to read a parquet file with the "FeatureReader" transformer and I have no problems doing so. However, the three columns that I have in my parquet file, which are datetimes [ns], do not appear in the parquet. If I use an "Attribute Exposer" I can't get them either, they seem to come as "missing". Any alternative in this regard?
I'm trying to copy metadata from SDE (Test) to SDE (Prod) environment. Any help would be greatly appreciated.
Hi,I need to write to several feature classes with the same schema but different prefixes to the names e.g. FAIL_wPressureMain. I am using an XML workspace schema only as template to define the output ( has subtype and domains). In the schema there is wPressureMain. The writer creates a feature class wPressureMain with everything correct but when I output a prefixed name e.g. FAIL_ the the subtype is not respected (haven't checked domains yet). I am presuming at the moment that somehow the new name does not match the schema 'name' wPressureMain and hence thinks it's something new and just writes out the data with the new name , loosing the subtype definition? Is there a way to fix this or is this correct behaviour? Or something broken in my script?I could create a schema for FAIL_wPressureMain and all my other classes and prefixes likewise, the result would empty feature class output, creating a different problem of deleting empty stuff ... python script ... Shouldn&#
The project number attribute from the TPL Corridors and Concepts layer did not exist in the target TDE Projects layer. However, I created a separate workspace that added in the field of TPL_Project_Number field into the TDE Projects layer already, so the target TDE Projects layer has the field in the table. This is my current workspace.This is how the attribute manager configuration is:The issue I am experiencing is that the script is inserting new records with just the tpl_project_number into the target TDE Projects layer, but I want these tpl_project_numbers inputted into the target TDE Projects layer for only the TDE Projects and TPL Corridors and Concepts polygons that overlap one another into the existing corresponding records, and not new ones altogether if that makes sense. Is there another transformer that would enbale me to do this or is there a transformer I am missing here?
How can I fix the texture that the 3D-tiles writer puts out? When converting from obj(including .png and .mlt) to 3D tiles, the writer makes the texture very dark when they are being viewed in Cesium. There is no problem converting to kmz, the textures is perfect there but we need to use 3D-tiles for its streaming capabilities. KMZ: 3D-Tiles: I have read multiple posts on FME forum and on Cesium forum:including this idea: https://community.safe.com/s/bridea/a0r4Q00000Hbqi5QAB/options-to-choose-and-set-gltf-appearance-settings-in-cesium-3d-tiles-writer https://community.cesium.com/t/how-to-set-lighting-for-cessium-3d-tile/5140 https://community.safe.com/s/question/0D54Q00009cNpu2SAC/i-want-to-create-textured-models-to-cesium-3d-tiles-from-obj-files And more posts. Does anyone have an idea how to fix this issue? Right now I use this, this helps to fix a transparent issue I faced before.Here is the .mlt from the obj if it helps:newmtl SolidKa 1.0 1.0 1.0Kd 1.0 1.0 1.0Ks 0.0 0.0 0.0d 1.0N
I'm trying to setup a workspace that allows the user to choose what attributes to keep in the final spreadsheet. But AttributeKeeper seems to work wrong when passing User Parameters in the "Attributes to Keep" box. I've created a User Parameter of the type "Attribute Name" that allows to select multiple attributes, and I've setup AttributeKeeper to use this parameter. I'm facing the following:1- When selecting only one attribute: Schema gets lost, but the attribute is still retrievable by exposing it.2- When selecting more than one attribute: Both schema and attributes get lost.3- Noticed that AttributeKeeper has a comma delimiter when multiple attributes are selected, while "Attribute Name" User Parameters use a blank space as a delimiter. So I've created a third parameter of the type "Text" with the value "a1,a2" (where a1 and a2 are the attributes), to see if this makes any difference. This again results in no sch
I am trying to test a bunch of IFC files containing different sets of IFC classes like IfcBeam, IfcColumn, IfcReinforcingBar etc. When I change the filepath in a user parameter, FeatureReader changes accordingly as per the presence of IFC classes in that respective IFC file(Refer images), resulting in breaking links with the next transformers. I also created a dummy IFC file manually adding in all the IFC classes which are there in all the IFC files I have till now. But this is not a reliable solution as future might hold some other classes as well. Kindly try to suggest me a reliable solution I am surely missing at the moment.
Hello! I have a workspace selecting a feature then passing its geometry into a different workspace for analysis: However, I receive these messages and the second workspace doesn't run:WorkspaceRunner_CleanerUpperOfBatchesInitiator (CreationFactory): Created 1 featuresWorkspaceRunner_CleanerUpperOfBatchesDoWeNeedToDoIt (TestFactory): Tested 1 input feature(s) -- 0 feature(s) passed and 1 feature(s) failedWorkspaceRunner_CleanerUpperOfBatchesRunner (TestFactory): Tested 0 input feature(s) -- 0 feature(s) passed and 0 feature(s) failed Here is the Geometry Extractor: Here is the WorkspaceRunner: Troubleshooting: When I removed the geometry as a parameter for the second workspace, the WorkspaceRunner succeeded. If I copy the GeoJSON text directly into the analysis boundary box, WorkspaceRunner succeeds as well. I would love some guidance on this! Thank you!
AreaGapAndOverlapCleaner has turned on itself, see examples below. The changes occur within tolerances, but the transformer should only be modifying gaps between neighbouring polygons, not itself? I have checked incoming features with the GeometryValidator but can not find anything wrong with them.What is going on here? Before AreaGapAndOverlapCleaner (this is a river) After (AreaGapAndOverlapCleaner thinks there is a drought and has turned the river into puddles) Before and after combined Another example: Here AreaGapAndOverlapCleaner (light brown) has attacked corners and bends. See the tip of the left area, and the small slivers in the bend on the far right have been introduced by the transformer.
By referring to the article Creating a Custom Format and section Using the Custom Format Wizard, I have created a custom format along with few (Published) user parameters.However, when consumed the custom format via Workspace Resources of a new FME workbench, user parameters those were created in the custom format were not appearing. Did I miss anything here? I was expected to see the user parameters that I have created in custom format. Enclosed the .FDS that I have created. FME 2022.1.0.0 (20220704 - Build 22618 - WIN64) @david_r @Mark Stoakes @debbiatsafe @chrisatsafe
Hi, I'm following the FME Basic course, here exercise Flood Risk Project within the module Use Conditional Value. In the course text the Inspector result is shown in the picture attached here ("... Inspector according to exercise").However, in my FME the outcome is different (see "... Inspector"): other names and 3 items instead of 5 items.I checked the conditional values used in the AttributeManager several times, it is exact the same as in the course text (see "... Conditional Value" Any thoughts?
I have 3 tables, a linear tables of sections, a non geometric table of bus lines, and a intermediate table between both, with relations N:M. I need to merge the sections to get the geometry of bus lines. but some of the sections belongs to many bus lines, so I need to "duplicate" some of the sections. Any idea of how to get the geometry of bus lines? Thank you again
Hello,on the SchemaScanner transformer, in the data types section, there is a parameter to define the action to be taken for attributes with the value Missing/Null/Empty.When ignore is selected, if an attribute has no entry, it is excluded from the schema. This seems correct for Missing. But is this the case for Null and Empty?In the latter case, shouldn't the attribute remain in the data model?If not, what other prossibility exists for retaining an attribute that has no value entry in the data model? Best regardsPatrick
I am using the OpenAIChatGPTConnector in my workbench. I thought that I provided all the correct parameters. But I get the log error: OpenAIChatGPTConnector_HTTPCaller: An error occurred while accessing the URL 'https://api.openai... What might be wrong?
I want to generate a textured plane top-down projection from a mesh. Like a raster equivalent for the SurfaceFootprintReplacer, which would derive a footprint polygon. Is there a transformer for that use case?
Table 1 Table 2
I have an FME process that requires me to read in an AGOL feature service that includes attachments and write the data and attachments to tables in an Enterprise SDE database on our servers. I've gotten this entire process to work on a smaller copy of some of this data, but for some reason when I run the process on the larger set of the data, none of the attachments that exist on the hosted feature layer are read by the reader at all. I definitely have "Include Attachments" turned on, and I've exposed all of the attachment related attributes: everything is identical in the FME process to the one that functions properly. There are some minor differences in the way these layers were uploaded to ArcGIS online, so I'm just wondering if there's ANYTHING on that end that could be causing this problem.
Hi, I'm following the FME Desktop Basic training, now doing exercise "Flood Risk Project" (under "Use Conditional Values"). As it is clear that I'm newbie to FME, so maybe this is a stupid question: where can I find the parameter "Elevation"? See pics attached here. This parameter is not listed in the AttributeManager, nor in other Read items. The FME workspace can be found here. Maybe I overlooked something?
We had numerous SQL Creators based on JDBC connections that worked in both FME Desktop and FME Server. We are in the process of migrating our SQL Creators from JDBC to Microsoft SQL Server Non-Spatial (ADO). In doing so their SQL continues to perform well in Form, but now generates Warnings when executed on Flow. The Warning takes the following form:"Microsoft SQL Server Non-Spatial Reader: Getting Custom SQL schema failed. Custom SQL query 'SELECT ... WHERE ... ORDER BY ...' may execute in an unexpected manner. Make sure all columns are named (any ambiguous columns, e.g. GEOM.STBuffer(1), must have an AS clause). If there is an ORDER BY clause, either remove it or add a TOP clause." Removing the ORDER BY does eliminate the Warnings generated on Flow. However we enjoyed using the power of the database to presort the records prior to being transformed within the workspace. Why is ORDER BY incompatible with Microsoft SQL Server Non-Spatial (ADO), and what other altern
How can I assign user parameters via a file? I have a large number of parameters and they all need to be pre-assigned. However, the content of the parameters can change. Therefore a variable solution is needed
Using string searcher with the search text LB I identified the number in the red box on the left. The number always contains the text LB and the same number of characters after LB. There are a lot of PDF's where the file names need to be changed to the LB number. Below I attached a screenshot in which I used a tester and a string searcher. I can find the LB number but how do I copy it to the writer name as output and how can I easiliy process aproximately 1000 pdf's in one go without manually changing parameters?
We have a selection of roughly 40,000 Uber H3 Hexagons. From this set we need to randomly choose 10 hexagons to perform a survey within, and would like to then select 10 more hexagons as alternates should one of the original 10 not be suitable for survey. Our first attempt used two Samplers. The first Sampler selected 10 features using the "Randomize Sampling". The second Sampler was fed from the NotSampled port of the first Sampler, and 10 more features were selected. Unfortunately both Samplers are selecting very similar patterns. Consistently, nearly every feature of the second sample is a neighbor of the first sample. In our second attempt to get a more randomized pair of samples, rather than a repeated pattern, the first Sampler selects 20 randomized features. Those 20 are then fed to a second sampler to choose 10 from those 20. This approach generates what appears to be a more randomized sample of both primary and alternate survey hexagons. Is there a better way