Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 12,684 Posts
  • 50,748 Replies
12684 Posts
joe.fme
Contributor
joe.fmeContributor
asked in Transformers
Formatting number (8,2) for SQL Server

Hi all, I'm trying to write a fixed-length number to a SQL Server Non Spatial database, and most work fine, but this one doesn't - Microsoft SQL Server Non-Spatial Writer: Unable to format data '4411398' for column 'ciFloorArea' of type 'numeric(8,2)' The other numbers look like so, and must be the exact 8 and 2 parameters - 1305256844113988248072 I just wondered if there was anything I was missing with the one that's throwing the error up? Thanks

1342
joe.fme
Contributor
3 years ago
tim_bkr
Participant
tim_bkrParticipant
asked in Transformers
Separate a string into parts according to alpha or numeric characters used

I have an identifier attribute which can take different forms.All contain a number, like 985 or B985 or 985aSome are preceded by a capital letter like B985Some are followed by a smallcaps letter or the character "*" like 985b or 985* I wantthe capital letters at the beginning of the string to go into attribute PREFIXthe numeric to go into attribute NUMBERthe smallcaps letter or the * to go into attribute SUFFIX I imagine using regex is the way. I have got the job partly done with a series of StringSearchers but I'd like to have advice from someone with experience. Thanks in advance !  

42
tim_bkr
Participant
3 years ago
tim_bkr
Participant
tim_bkrParticipant
asked in Transformers
Identify identical geometries from two datasets I have two building datasets and I need to identify which buildings from dataset A exactly match the geometry of a building in dataset B. What's the best way to do this ?

Identify identical geometries from two datasets I have two building datasets and I need to identify which buildings from dataset A exactly match the geometry of a building in dataset B. What's the best way to do this ?

394
tim_bkr
Participant
3 years ago
R
robeesafe
asked in Transformers
I have data in Excel with Lat/Lon converted to points using VertexCreator in LL-WGS84 and an AOI-boundary shapefile converted to LL-WGS84. When I clip the points lying within the boundary using PointOnAreaOverlay, the resulting points are 400km east

89
R
3 years ago
H
hallkbrdz
asked in Transformers
Help me to understand the odd results using FME 2020.2, connected to SQL Server 2014 running TSQL.

I'm using FME 2020.2, connected to SQL Server 2014 as sa with a database specified using the non-spatial connector. I am trying to create automated Excel reports for SOX audits using three SQLExtractors running one of these each: sp_helpsrvrolemembersp_helprotectsp_helprolemember The results I am getting do not include all the rows I get with SQL Server Mgt Studio connected to the db specified in the FME connection. I also tried adding "Use DBNAME" as the pre-sql with no change. Help me to understand why this is, and how I can get the same results as SSMS (hopefully). Thanks...Bryan

41
H
3 years ago
L
left65
asked in Transformers
Challenge for the FME experts out there - relates to data matching based on values. This is not a spatial question - its a question about migrating financial values using FME. See below for full explanation

I have a set of data, coming in from an sql database. I have a tester that then splits this into two streams - one stream contains details of all positive value transactions and the other contains details of all negative value transactions. Each transaction has a unique reference. I need to be able to say which DR transaction a CR transaction has been applied to but the kicker is that the CR transaction might not be for the full amount of a transaction and a later CR transaction might apply to the same DR transaction ie multiple CR transactions apply to same DR transaction. I also need to be able to assign a balance to both transactions but this needs to be the balance at the end of the transformation. The attached excel document might explain it better

61
M
3 years ago
K
khibma
asked in Transformers
Using VertexCreator and ArcGISOnlineFeatures put point at 0,0

Hi,I'm parsing text files - I'm using VertexCreator to take lat/lon columns to get a point. I have CoordinateSystemSetter going into it.I'm passing the VC into an ArcGIS Online Feature Writer for points (geometry is set to arcgisonline_point). I set the writer up with Import Writer Feature Types (as suggested)This process successfully creates the point in ArcGIS Online, but it always places it at 0,0. It writes properly if I used a writer to FC on disk and use that FC as input to the online feature service. I'd like to skip the unnecessary? writing to disk if possible. Is my workflow correct? Is there another step/setting I need with the VC?thanks

565
chrisatsafe
Contributor
3 years ago
J
jgarciafdez111
asked in Transformers
Detect a plane from a point cloud

Hi guys, Is it possible to detect a plane from a point cloud. Specifically, I have a point cloud of a box (cube), and I want to detect one of the faces (e.g the top face). My cubes tend to be supported on an almost horizontal plane, that is Z direction of the box, is very close to the Z axis. The final challenge is to estimate the inclination of the top face, relative to the reference axis. Do you have any idea how to move forward here? Thank you very much!

3002
J
3 years ago
G
garyhk
asked in Transformers
I've found that when providing an excel worksheet name via the initiator for the feature reader transformer, it can't find a sheet that has spaces in its name i.e. 'as at 30Nov20', but it can find the same sheet if I rename 'as_at_30Nov20'.

Is there some setting that needs changed?​

93
G
3 years ago
fmenco
Contributor
fmencoContributor
asked in Transformers
Transformation to DWG with Microstation cell library

I want to transform data from a database to CAD(DWG to be exact) with certain symbology. I have a Microstation cell library. How can I use the symbols in this library as a DWG template, either in the parameters and/or in the DWG styler? Transforming to DGN works fine, but I can't seem to be able to transform the cell library to be used as a DWG template, and using it as is results in an error.

542
fmenco
Contributor
3 years ago
tim.rastall1
Contributor
tim.rastall1Contributor
asked in Transformers
Any way to convert Hex to a signed integer - Base converter doesn't support signed values.

Hi Community I have some binary that represents signed 16bit values that I am encoding as hex (with the Binary Encoder) and was hoping to then use the base converter to convert the hex into a signed decimal but it turns out it only supports unsigned conversions :(.Does anyone have an ideas on how to perform this conversion? I have doen much googling but without any luck.I would be quite happy to offset all the values by +32767 to get them all into a Unit16 range if there was any way to do that.... Cheers!

1082
nielsgerrits
VIP
3 years ago
houxianyong
houxianyong
asked in Transformers
Why not shown a selection of available geographic transformations is provided once a Source and Destination Coordinate System are set.

Arcgis10.7.1 is normal, and the seven parameters of the conversion are set well. The conversion is normal in ArcGIS. However, when using the ESRIReprojector converter, the source and destination coordinate systems are selected, but the 'geographic conversion' parameters are not automatically generated and optional

65
houxianyong
3 years ago
rob_m_esriuk
Contributor
rob_m_esriukContributor
asked in Transformers
SQL Executor returns 0 rows when there are rows present. SQL Azure db

We have a workbench which is driven by a where clause and an SQL Executor which picks up data driven by the where clause and process this. Occasionally we are seeing a bunch of consecutive jobs select zero rows in this transformer. We've tested the SQL and it returns the expected, we've re run the same predicate and it works ok.My surmise is that some sort of failure occurs between SQL Server and FME but the SQL executor is not handling this well and not reporting any failure. We do see failures in the connectivity between our FME Server and the Database and usually these fail the translation but in this case all we are getting is a _matched_records of 0.Has anyone else seen this behaviour, in our case now i've found it the task can be terminated and the data will be picked up by the system and resubmitted, however I now start to wonder if we are missing this anywhere else!

1002
rob_m_esriuk
Contributor
3 years ago
M
mrdado12345
asked in Transformers
Texturing building model with point cloud

Hello, I can't seem to find an question/answer or an article about texturing buildings models with a point cloud. Is this possible to do in FME?  Here's a paper on that topic: https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XXXIX-B6/161/2012/isprsarchives-XXXIX-B6-161-2012.pdf Also, a video on Undet for Sketchup manual application (but I would expect an automatic way, like in the article earlier): https://www.youtube.com/watch?v=2JsG-PQTNlM&ab_channel=UNDETPointCloudSoftware The idea is to create a building model from a point cloud and assign texture from the same point cloud in order to achieve a realistic model. Thank you!

120
M
3 years ago
J
jakeweaver
asked in Transformers
Getting Schema Reader to see SQL SERVER Database connection?

Hi folks, I'm trying to get the SCHEMA reader to read a MS Sql Server non spatial database. I keep trying to give it the correct Database Connection - but at the moment it wont. see it. Is there a way to make the Schema reader correctly get the database connection properties?

662
J
3 years ago
mark_zl
mark_zl
asked in Transformers
Summarize data\\Transpose

Hi I'm not sure on the correct transformers to do the following?   source data

142
mark_zl
3 years ago
I
ifitch
asked in Transformers
Can not update Geopackage table with Change Detector

I am stuck with the problem of updating a table in geopackage.I am reading excel records which have a unique Excel_ID number. Then, after some transformers I write the result in a geopackage non spatial table with the primary index column FID set in writer's parameters. Also I track changes with the Change Detector based on Excel_ID field, where the Original features is destination geopackage table and the Revised is the excel table. Further, if I try to write updatet rows in geopackage table with the selected Excel_ID as the ID attribute of the Row selection of a writer parameters, I get an error since the Excel ID is compared with the geopackage FID, which, of course, are different. Then I tried using Feature Merger to combine the updated excel rows with the record from the geopackage table to attach geopackage_fid to the rows join on Excel_ID field. ID attribute of the Row selection of a writer parameters I set to geopackage_fid.However, this time some of the features are suc

219
M
3 years ago
M
michelle_onasse
asked in Transformers
I would like the change the geometry (segment) of a road.

I need your help. I got two roads from two different readers. Those describes a the same road and they are basically the same. But, their segment isn't the same. ''Readers B'' has 300 more attributes than than ''Readers A'' and I can find more descriptions who are useful to me in the Readers B. But, I want to keep the Readers A because there is some segment that I don't find in the Readers B. Thus, I need to change the geometry of the Readers A into the geometry of the Readers B. Can someone help me?

52
M
3 years ago
M
matte
asked in Transformers
Extract point elevation data into shapefile from rasterdata

Im trying to extract point data into a ESRI shapefile from rasterdata, but i'm very unsure what transformers I should be using? I've been laborating with rastercellcoercer and coordinateextractor but I just can't get it to work. Anyhone have an idé where to start? I could need a push in the right direction at the moment.

72
M
3 years ago
nic_ran
Contributor
nic_ranContributor
asked in Transformers
SchemaMapper alternatives?

Hi,I don't have a specific problem that I'm trying to resolve, I'm just looking for opinions/discussion on alternatives. More of a "poll" on what types of solutions people might be currently using...The SchemaMapper transformer can be very handy but it definitely has it's limitations and it feels like it's getting a bit long in the tooth. I don't think there have been any significant changes made to it in several years, so I was wondering if people are still using it, or what design patterns might be used as an alternative?Some of the limitations of the existing SchemaMapper transformer that I'm aware of are:No ability to parameterize input parameters, esp. the schema mapping fileNo way to perform complex "and/or" conditional mappingNo way to use conditional operators other than "=" in mapping rules (e.g. <,>,!=, in, like, etc.)No way to map if null/empty/missingAside from manually performing these mappings in the workspac

2413
nic_ran
Contributor
3 years ago
mahbouberezaiee
mahbouberezaiee
asked in Transformers
IFME Null after writing my file to cityGML

Hi. I want to write my file which consists of some IFME Faces to Ground, Roof and wall surfaces. But the results after Writers are IFME null. How can I fix this Problem? I need some faces at the end

61
daveatsafe
Safer
3 years ago
M
michelle_onasse
asked in Transformers
I would like to divide a road by equal segment

Hi community,I would like to divide a specific road by equal segment of 10 meters. Is it possible, and which transformers should I try? I tried some, but it didn't result with the result I'm looking for.​ Thanks.

03
hkingsbury
Celebrity
3 years ago
tcrossman
Contributor
tcrossmanContributor
asked in Transformers
Proper way to write out User Attributes (Manual definition mode) in AutoCAD Writer so that they are visible in ArcGIS and AutoCAD?

I am writing out AutoCAD points--no blocks--to a new CAD file, but I want to save the Block Name, Layer Description, and Source File info for use later. For that purpose, I have created three User Attributes (in Manual definition mode) in the User Attributes tab of the CAD Writer: BlockNm, LyrDesc, and OrigSrcFile, respectively, and populated them with values from existing attributes. When I look at the attributes of the output CAD file in ArcGIS (Pro or Desktop) or in AutoCAD Map 3D, I do not see these added user attributes. During translation, I get a warning message that the OrigSrcFile value had to be truncated (I'll handle that later), so it appears that the Writer is actually writing out those user attributes. I just can't see them in ArcGIS or AutoCAD. Should I be writing out the User Attribute differently to make them accessible in ArcGIS and AutoCAD? (I do see in help files that ArcGIS Pro reads user-defined block and Civil 3D attributes, but the help does not e

191
daraghatsafe
3 years ago
thard
thard
asked in Transformers
How do I batch rename several shape files based on their parent folder name and/or write that folder name into the file as a new attribute?

Hi I've tried following the recipe in this article https://community.safe.com/s/article/Using-the-Directory-and-File-Pathnames-Reader-Record-File-Metadata for reading metadata on a bunch of shape files stored in different subfolders (one *.shp per folder) in parent folders in a collective project directory.All the shape files (54 in total) have the same file name "Vejle.shp" with similar attributes in them. So I only have the distinct [parent-folder/subfolder] names to identify them from another. My goal is to use the the outcome metadata for renaming all the shapefiles so they are matching the folder names. Or even better: directly write a new attribute to the files based on the respective input folder name as i transform and load my data from shape into one feature class in an ESRI file geodatabase.How do I do that?

761
debbiatsafe
Safer
3 years ago
R
rsuinn
asked in Transformers
Extracting values from a Double Nested JSON array values

Like others, I've also been stumped on how to do this after trying variations of the JSON transformers.Can someone upload an FME sample snippet or provide detailed instructions on how this can be accomplished?Thank you in advance!! I have the following JSON which contains an array within an array.I'd like to:extract the TaskListType from the 1st array (MaintPlanData)extract the OperationNum and OperationDesc values from the 2nd array (TaskListItems)and put them into a row/column format like the example below. TaskListType OperationNum OperationDescABC 0010 ExecuteABC 0030 TechnicianABC 0040 RecordEFG 0010 Executeetc { "RemainRecCount": 0, "MaintPlanData": [  {   "ScheduleIndPlan": 1,   "PlanItems": {    "ItemNum": 1234,    "TaskList&q

5442
R
3 years ago

Badge winners

Show all badges
30,177
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.