- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,780 Posts
24,926 Replies

When you subscribe we will email you when there is a new topic in this category

6780 Posts

Recently active

Most replies Most views Newest first

mbarzegar

asked in Data

Is there any way to extract the geometry of IfcRelSpaceBoundary in FME?

HelloI could extract the IfcRelSpaceBoundary using the Deprecated reader. However, it doesn't have any geometry. There is an attribute (Connection geometry) which refers to the instance_name of the related geometry but I can't retrieve this geometry. Is there any way to extract the geometry of IfcRelSpaceBoundary in FME? @daveatsafe

indentify slopes using DEM

Hi all, I am trying to make a .shp from the areas with a minimum slope (DEM). The picture shows the output of the RasterSlopeCalculator (its about areas around water). I need to find a way to identify the transitional value of slope where the colour white turns to black, and then filter out the black areas. If someone has an idea, or knows if this is even possible, please let me know! :) Thanks.

How to get the written data to Esri ArcGIS (AGOL) feature service using python

In Esri ArcGIS (AGOL) feature service writer, there is an option to view written data in fme.How can I access these written features in python ?

4 years ago

jalejandroruizc

asked in Data

Smallworld Translator Error: Value ... out of range for field new_key.

Hi!I´m trying to load a polygon layer (buildings) from a shapefile to a Smallworld Database and I got the following error message at the end of the process:“Smallworld Translator Error: Value 5848495342526991361 out of range for field new_key”I have done this before without any problem. Can you hlp me, please?Regards.

Search Time optimization in FeatureReader Files

Hi! I have an Excel file with ID numbers of different train stops, 20 of them. I wanted to find all DWG files that are in the subfolder Z\\Modell\\.*03.dwg but it takes around 1 h to run, at this point is it faster just to find them manually and run the workspace. Is there any way to improve the search time? The "root" folder is a drive, but all files are within a folder is called "4\\_CAD" so I limit the search to only the subfolders of my starting folder. Trying to make it faster my only use the subfolder I know contain the other folders and files.I was thinking maybe change it to have 2 feature writers after eachother instead, one that only searches for the correct folder then look for the files within the found folders. Change allowed path type to only folders then only files. Other suggestions?Also I figured if I have 60 subfolders, for every feature read it will look in all 60 of them 20 times over, that's probably why it takes such a long time, is there a

is there a way to have the same number of output files as input?

Hello, I am new to this software, i have a bunch of KML Files that i have been successfully been able to edit. However when i go to run the software it combines them into the same file, is there a way to have the same number of output files as input? i.e. save individually not combine them

4 years ago

clarew

asked in Data

A Rasta Layer from a MapInfo file

Working in a company with a variety of software packages, I have been tasked with making an unusual MapInfo layer available as read only in QGIS. The difficulty is that a lot of the data on the MapInfo layer has been added as text direct to the map, with a variety of font colours, rather than being held in the attributes table and applied as labels.Is there a way to convert the MapInfo layer into rasta layer to view in QGIS, almost as a photo of how it would appear in MapInfo?Thank you

4 years ago

gogopotter90Contributor

asked in Data

copy some sheets include texts to new excel and add new sheet from another excel to the same excel output

i want to copy the first sheet that include name and number to new excel sheet and rename it to Roads and copy the second sheet to sheet called details and i want to add another sheet ,output of fme but i got it from another excel .so at the end i want to get 3 sheets ,roads,detail,result i did static calculator for the third sheet and get my output but from another excel so i should have three sheets in result excel two from roads and one output of fmebut my output from work space ,i want to change it to blank page and write my output ,looks like the another sheets. my filesThanks for help

614

4 years ago

p.jeremieContributor

asked in Data

Accents/Diacritics in Excel formulas

Hi, I encounter the following problem with the XLSXWriter : When I have a TEST.fomula containing accents (for exemple é or É), the formula is not written in my output file.The following formula for example : =IFERROR(SEARCH(CONCATENATE("/";B@Value(LIGNE);"/");W@Value(LIGNE));"PAS TROUVÉ")Note : I do have a 2nd attribute called TEST, in addition to the TEST.formula attribute containing the formula.Any idea how to solve this and get my accent in the Excel output ?

How do I control the execution sequence for path/filecopier

Hi all,A very dumb question: below part gives me what I wanted which is to copy a file from a folder to another location. But how do I control the sequence so that this part is executed first, and then go to other part of the scripts. I meant both "Path" and "FileCopy" don't have a connector (to connect to previous step or to the next step after these are done).

DWG Writer - Points with block name to INSERTS and Lines to lines not blocks

I am creating a tool to clip a dataset (ESRI FGDB with multiple feature classes) then write the data to a dwg file with the following:1 - any point feature with a block name in the attributes to the corresponding block in the Template file.2 - any point feature without a block name in the attributes to be an ACAD point in the layer specified in the attributes3 - any line feature to be a 3d polyline / 3d line in the layer specified in the attributes.So far i have been able to achieve each of these separately but cannot get the required output in a single file.Sample workspace below:Below is an example output:Red arrow - shows the line represented as a block --> this needs to be a 3dpoly or lineGreen Square - shows the block attribute for the point with block value in attributes. --> this is correct

961

4 years ago

solyContributor

asked in Data

How can i do two tables at the same sheet ,second table under last row of first table 5 rows

if only the machine is working i mean in case of Y make table 1 in the 3rd row in sheet called machine and include only in the table machine and working column if working no ,make second table under last row in the first table 7 rows down and also make new sheet called amountit will has table year and amount columns if the machine working is yThanks in advance

The best way of reading excel from Share Point

Hi,One of my FME projects is 90% done. The only thing that's stopping me from completing it (and putting it into automation) is the issue that I'm having with excel reader. FME seems giving me errors sometimes (not always) at the excel reader (Feature Reader) (which reads an excel file from our own Share Point site). It works fine if I go to the SharePoint site by myself before running the script (or poke around the transformers either by parameters button, or containing folders button, etc.), which for me it indicates the problem is about the access to the file/site. But how do I mitigate this problem. Can someone please help? Thanks.

1023

4 years ago

jasperwisEnthusiast

asked in Data

Civil 3D Reader - property sets - fatal error

Hi, I want to access the property sets a of a dwg in FME.I enabled the 'Civil 3D and CAD Entities' option in the Schema Mode of the Civil 3D Reader.When i attach an inspector to the reader, I get a fatal error.AutoCAD Reader: An error occurred for dataset 'C:\\Users\\wisbeja\\Documents\\AWV\\FME voor dataconversie DAVIE\\voorbeeld data\\DWG solid and prop set\\small_test.dwg', in function AutoCAD2004Reader::read. Exception thrown: 'Invalid ResBuf' (Invalid ResBuf)A fatal error has occurred. Check the logfile above for detailsdwg file is attached.When I read the dwg with a dxf/dwg reader the inspector works. But I guess I am not able to access the property sets with this reader. Any suggestions? Jasper

Microstation curves and Bspline curves

Unable to correctly convert DGN which contains MicroStation traditional curves and Bspline curves. The resulted curves are stroked incorrectly. What is needed that stroked line follows curves more accurate. The undocumented parameter for dgn reader "Number of interpolated curve vertices" works for curves but not for Bsplines.DGN reader :: Result is not as expected

If no data comes through the workbench to a specific excel worksheet how do I ensure that the writer shows no data.

I have a workbench to look at changes between a new worksheet and an old worksheet. These data populate three tabs in a workbook: "changed", "deleted", "updated". The intial run populated the deleted tab with a few records that had been deleted. I re-ran the workbench with matching data and the "deleted data" remained on the deleted tab. I would like the data on the tabs to be overwritten each time.

Determining if an autocad layer is frozen in an viewport

Hello all,Does anyone know how to determine if a layer in an autocad file is frozen in a viewport?I need to determine if model_space features are visible in a particular viewport. I have done this by reprojecting the viewport's geometry to model space and then testing if it contains the feature. This works well, however in autocad you can freeze a layer in a viewport, in which case that layer is not drawn in that viewport and I need to account for this. I can see the features have an "autocad_layer_frozen" attribute, however this seems to define if the layer as whole is frozen not if it is frozen in a particular viewport.The viewport's extended_data_list list include's the frozen layer's name: In this case "LSSA-DIST_ANNO". However I don't know how to parse the extended_data_list.I could just search the entire extended_data_list for the layer's name, however I am worried that there may be cases where the layer's name appears in the exten

XML templater conditions based on geometry

I want to export some data to gml, and I see that I have some complex geometries, which results in different sets of coordinates for each polygon (after geometry extractor). I made a list and each element within the list contains the set of coordinates for each segment of the geometry, but not all the polygons have the extra dimensions. Therefore, I want to make an if-statement where only the extra xml-statement is shown when there is data in the list. I tried using this, but it does not work. Can anybody point out an error in the statement.Not only the line with the statement posList..., but also the other statements around them, I want to delete when the list element is not existing. If there is another way of doing this (e.g. with a loop), I am open to suggestions. </gml:exterior> If {(fme:has-attribute("interior_xy_l{0}.part")) then ( <gml:exterior> <gml:LinearRing> <gml:posList&g

4 years ago

clangContributor

asked in Data

S3Connector Error

Hi, I'm having trouble connecting to a public S3 bucket. I have a file i would like to download from this bucket however when configuring the S3 connector transformer I get the error message 'NoneType' object has no attribute 'lower'. I have upgraded the transformer and i'm using FME 2019.1. Screen shots of the configuration and translation log error message below.Any help or guidance greatly appreciated. File "contextlib.py", line 112, in __enter__ File "C:\Program Files\FME 2019\python\pypac\api.py", line 273, in pac_context_for_url pac = get_pac() File "C:\Program Files\FME 2019\python\pypac\api.py", line 57, in get_pac return PACFile(downloaded_pac, **kwargs) File "C:\Program Files\FME 2019\python\pypac\parser.py", line 62, in __init__ context.FindProxyForURL('/', '0.0.0.0') File "C:\Program Files\FME 2019\python\js2py\base.py", line 1120, in __call__ return to_python(parent._obj.callprop(meth, *args)) File "C:\Program Files\FME 2019\python\js2py\base.py", line

Error while using AGOL writer

Hi there,I am trying to write FME transformed data to AGOL using AGOL writer. Here are my steps for writing AGOL:1) Created feature class on AGOL that has the same number and name of fields as it is in FME transformation.2) Use AGOL writer and set the constraints Feature service to the same feature layer created in the first step. 3) Give a name to writer the same as the feature class has. When I run the transformation, it throws an error and states that 0 features successfully written to the layer. Please note that data on the FME transformation does not have field/attribute called Object_ID. When I go to the AGOL, I found that 851 out of 24435 features were present online. Could anyone help me where am I making the mistake?

Is it possible to download/read an excel file from Sharepoint?

Hi, Is it possible to download/read an excel file from SharePoint? I can read the contents of the site using the SharePoint list reader, but unsure if I can then actually read a spreadsheet stored there? Thanks, Sam

CSV: failed to open error

Hi,The file path was working fine on Workbench but it's giving me this error when I put the FME script in Task Scheduler (or Command Line).

Trying to create KML Network Links

I have a workbench to read a bunch of large KMZs which I create a surrounding polygon with some attributes and write out to one master KMZ. What I want to have in each output feature is a Network Link to the detailed original KMZ but cannot figure out how to do this. I saw in an FME tutorial, Optimizing Large Datasets for KML and Google Earth, where they created Network Links by setting the output feature type to NetworkLink and populated kml_link_href and kml_link_name which I was able to do but all it did was read the referenced KMZ and put all of it's elements into my output KMZ which seems to defeat the purpose of a Network Link being a user clickable link. Is it possible in FME to create a clickable link in my output KMZ that would open the referenced KMZ ?

UPDATE in postgis with binary data fails, INSERT works

I have a workspace that is trying to upload a bytearray into an existing PostGIS table, into a ByteA column. The data is generated in a python caller.Using INSERT, this works fine. There is no problem, and the resulting data can be read from a different client as expected.However, using UPDATE it fails, stating:Error executing SQL command ('update "public"."mesh_test" set "ogc_fid" = 694,"mesh" = E'\003\000\000\000\212\032\005H\004\362\336H33C@g\032\005H&\362\336H\205\353\021@\354\031\005H\004\362\336H\205\353\021@\001\000\000\000\000\000\000\000\002\000\000\000\001\000\000\000' WHERE "ogc_fid" = E'694''): 'ERROR: invalid byte sequence for encoding "UTF8": 0x00I can circumvent the error by encoding it into base64, but that yields data I can't interpret from another client.It seems that the update statement is done using a different method than the insert statement, which is odd. Has anyone seen this before?EDIT: Added example workspace, plus sqlfile to create and populate table. Y

nathContributor

Hi, Im trying to write data to an xlsw writer where i want for each partner a seperate excel file with a sheet for each municipality.So i tried to create a writer where i set my sheet name to an variabel attribute (gemeente) and then by the fanout option i tried the variabel attribute "gegevenspartner". But is doesn't work, what am i doing wrong?

102

4 years ago

Page 86 / 272

Badge winners

vertiroyhas earned the badge Integrate Spatial Data
digit42has earned the badge Student (Grey)
digit42has earned the badge Teacher (Grey)
digit42has earned the badge Welcome Back
rabih.mansourhas earned the badge Integrate Data with the FME Platform Training

Show all badges

30,110: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.