Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,701 Posts
24,707 Replies

When you subscribe we will email you when there is a new topic in this category

6701 Posts

Recently active

Most replies Most views Newest first

thijsknapenContributor

Why does a JSON reader convert JSON boolean values (i.e. true/false) to Yes/No boolean values?

I hope the title is already quite self explanatory.As an example, consider the following JSON document;{ "boolean_1": true, "boolean_2": false}When this is being read with a JSON reader, it returns the following output;I would prefer the data to be non altered, so that comparisons can be made later on.See also the following attached sourceFile and workspace; To me it reminds me of the following item I addressed earlier on;https://knowledge.safe.com/questions/90726/extracting-nested-object-with-jsonextractor-issue.htmlin which a JSON Extractor used to convert JSON boolean values (i.e. true/false) to 1/0 boolean values, where I'm glad to see that that got fixed.To me it only raises some concerns that the handling of these values doesn't seem to occur in a very consistent manner; whereas a JSON fragmenter does seem to keep JSON boolean values intact, initially a JSON Extractor converted these values to 1/0, and now I find that a JSON reader converts these values to Yes/No. :(

gogopotter90Contributor

How could export only specific area and the intersected of this area direct from oracle reader

i have reader oracle spatial and i would like to export only specific area and the intersected of this area only .i do not want to export all areas from oracle reader because it spends too much time so i would like to export the interested areas only from oracle . i did already spatial filter after that and it works great but the problem it takes too much time to export all areas then execute spatial filter so is it possible to write code inside where clause and as a result as give me rrequired areas without upload all areas .Thanks alot

stefanhContributor

How can I create a nested JSON from an Excel- or CSV-file?

I have a Excel-file with the following content: group1group2group3nameinfoGeneralNation Philinfo1GeneralNation Kareninfo2GeneralMunicipality Billinfo3GeneralMunicipality Paulinfo4SpecificProvince Patrickinfo5SpecificProvince Maikelinfo6SpecificProvinceGovernanceMikeinfo7SpecificProvinceGovernanceLukeinfo8SpecificDistrict Mariainfo9SpecificDistrict Davidinfo10 The attributes can be adjusted it is a Excel-file; I create the file myself.I would like to automatically create a nested JSON file. This should look like this: "name": "Overview", "children": [{ "name": "General", "children": [ { "name": "Nation", "children": [ {"name": "Phil", "info": "info1"}, {"name": "Karen", "info": "info2"} ] }, { "name": "Municipality", "children": [ {"name": "Bill", "info": "info3"}, {"name"

benvkContributor

Is there a simple way to add a 'total' row to a Excel Writer?

I am outputting many rows to an excel table, some of my columns are numeric, I am hoping to add a total row at the bottom of my table, to sum these columns. I have found the Statistics Calculator, but I have no idea how to apply it (if at all possible). Any thoughts?

changxianghao94

PointCloudeExpressionEvaluator Parameter type

I tried to fuse the shapefile information with the point cloud. When I clipped the point cloud based on the shapefile polygon boundary, the information of the count number of each polygon is supposed to be attached to the point cloud attribute. I saved this information in the userdata attribute but it is Uint8 data type, my count number should use int16 to cover the range. Is there any solution that can set the userdata data type as int16 without converting by the application automatically ?

swachContributor

ESRI Geodatabase Raster Dataset Footprint

When you view an fgdb mosaic dataset in ArcMap, the footprint and boundary are features that are shown and editable. I can read the fgdb raster dataset in FME but I can't figure out how to access the footprint and boundary datasets. Is this data accessible?

How to update single layer in existing CAD dwg with gdb feature class, while maintaining all other layers that already exist in dwg?

Hello, I'm still a relative newbie to FME, so bear with me. I'm trying to update our topographic CAD dwgs with our updated LiDAR derived contours. I only want to replace the existing contour layer and maintain all other layers in the existing CAD dwgs. I'm just not sure how to proceed. The contours are already clipped to the same index grid as the dwgs. Any guidance to the correct path of transformers would be most appreciated. Thanks everyone, be safe out there and wash those hands!

Writing Autocad text features creates block

HI, I looked at this great article: https://knowledge.safe.com/articles/38908/autocad-workflows-reading-and-writing-text-mtext-f.html And tried applying it for my project. By creating label of my feature id then using DWG styler:label = @Value(ID)gThe problem I have is that these do not text as the example article but creates a block with text tags. If I manually add text in autocad I get this: RIght TextBut instead I get this: Block ReferenceI wrote the text in a separate layer called LayerLabels, I even added a AttributeManager adding a new attribute autocad_entity = autocad_text and activated format attributes "autocad_entity" in the writer to maybe force it to read as text but its still created as a block.My writer:IN bentley it says its an FME block, but I never set any blocks and my only reader is a shp readerThis below is also supposed to say text with a T sign next to the Acad and supposed to show the text Any ideas?

Creating Empty File Geodatabase

Is it possible in FME to create empty Esri file geodatabases without any feature classes inside? Like how you would manually create them in ArcCatalog.

gboquinContributor

Project wise connector not downloading files with dependencies

Is this a bug? I am trying to list and download several files (some have dependencies-- references-- and some don't) and noticed that I cant download files that have an associated reference file.Any thoughts or suggestions?Thanks

deanhowellContributor

DWG Layer Frozen in Viewport

Is there a way to determine if a DWG Layer has been frozen in a viewport?We are reading in a DWG and want to output that to a TIFF Image but AutoCAD has a function that allows layers to be frozen in a particular viewport but I can find an attribute that indicates that for an individual feature.If I read model space through the viewport the layers frozen for that viewport are still be display and then output to the TIFF.Snapshot of DWG Viewport Snapshot of TIFF

Minecraft Writer Internal Error failed to create valid block index

I've just recently gotten started with FME, and have been converting point cloud xyz files to Mojang Minecraft format. My converter works for a couple files, but yields a cryptic error message for most of the files I've tried: MINECRAFT writer: Internal Error: Failed to create a valid block index in regionX: '-1', regionZ: '-1', chunkX: '30', chunkZ: '30'Since I've already scaled and shifted heights (z-coordinates in the point cloud, y-coordinates in Minecraft) well within the limits of Minecraft, and this is a chunk error, I feel I can safely assume this has nothing to do with height. I wasn't able to find any documentation of width and depth limits to the Minecraft writer, and the point cloud is scaled to a 64x64 area, so I'm not sure what's going on here.Any help is greatly appreciated! I can't find much information on the Minecraft writer.

p.jeremieContributor

Topological edition in Qgis not working after FME workspace

Hi, I have a shapefile 1 in which I can move common points between features with topological edition active in Qgis, without problem.After I read the file in FME and write it to another shapefile 2, this last one cannot be edited the same way (common points are moved separately even with topological ediiton active in Qgis).I tried to reduce the workspace to the minimum, means no transformer at all, only shapefile reader and shapefile writer ! Same behavior. Did you already have this behavior ? I don't know what I do wrong... I can send the shapefile if needed.

felipeverduEnthusiast

Image rasterize for las files

HiI am trying to convert las files into raster, for that I am using as recommended by Safe the following transformer ImageRasterizer as you can see in the attached image: But I keep getting the same error:ImageRasterizer (VectorToRasterFactory): 338432 input feature(s) were discarded because they were not compatible with any band in the raster. Bands with a color interpretation require vector input features with an 'fme_color' attribute. Bands with a numeric interpretation require vector input features that have Z coordinatesImageRasterizer (VectorToRasterFactory): No valid input features. 338432 input feature(s) processed. 0 input feature(s) with invalid geometry discarded. 338432 input feature(s) not compatible with the raster interpretation discardedImageRasterizer (VectorToRasterFactory): A fatal error has occurred. Check the logfile above for details

tacreeodotParticipant

How to Connect to FME Server Postgres DB Running in Docker

I installed FME Server on my Mac using Docker...running using docker-compose. I am wondering if I can connect to the Postgresql database external to the docker image from my Mac. Just interested in using it while testing, but not sure which port/user/pw to use. I couldn't tell this information from the docker-compose file. Any help would be appreciated.

FME2019 Civil 3D Reader

Hey everyone,There's been several topics on reading Civil 3D Property Sets on the FME forum, and according to the release notes for FME 2019 it seems that the the new version offers now this possibility. So I upgraded to FME 2019.2 but I now have a problem with the reader itself. Indeed when I try to read a Civil 3D dwg file with the same parameters as with FME2018 I've got this fatal error : Does anyone have an idea on how to solve it or of where it could come from ? By using an ACAD reader it works properly but of course I don't have the extended properties which are on Civil.Thanks by advance,Clem

IFC2X3 IFCFLOWSEGMENT point object Error no Geometry type

Hi forum,I have an IFC file that contains pipe network from 12D model. The IFC export contains pipes and some pit objects as points. I am not sure why this is causing the following object to return an fme_no_geom. i am running the data se through a GeometryFilter and these features are exiting in the null channel.fme_geometry fme_typefme_aggregate fme_no_geom #22 = IFCRELAGGREGATES('1hViQUWInAEPHHSf76Sqog', #2, 'SiteContainer', 'SiteContainer For All Models', #19, (#21));#23 = IFCRELCONTAINEDINSPATIALSTRUCTURE('3NoqxiDnb3pvSwt$HSi04p', #2, 'Building Container', 'BuildingContainer for Elements', (#24, #110), #21);#24 = IFCELEMENTASSEMBLY('2avVmq1XXFtBSLGB9qcGYj', #2, 'P22-02', 'test', 'Super', #13, $, $, $, .NOTDEFINED.);#25 = IFCRELAGGREGATES('0nKhssk3PFoRE08AYptVpP', #2, '', '', #24, (#26));#26 = IFCFLOWSEGMENT('14omJrvZL3jRzNkxjD4bwN', #2, 'P22-02', '', &#39

koenvdwContributor

Tiff 2 ECW without black background

Hi I have a workbench that converts Tiff tiles into one jpeg2000 with a transparent background.This is the bench: When I replace the jpeg2000 writer with an ECW writer I get a black background. When I load a jpeg2000 in Qgis, the background is transparent. When I load the ecw in Qgis I have to select in the settings under transparency band 3 as transparency band and then it's like the jpeg2000, but with an extra step. Sadly our customer works with CAD and there I cant remove the black background with a setting.... Am I doing something wrong?

eric_armitageContributor

Extracting subset of DWG features

I have a DWG file containing anout 400000 3D building features. Each feature has an fme_feature_type attribute such as "Roof" and "Wall". In the Inspector each feature has 48 attributes such as "autocad_block_number" etc. I'm trying to extract a subset of features to a separate file. I'm selecting an area of features in the Inspector and then using the "save selected" button to save the selection as a new DWG file. It saves ok but when I read it the fme_feature_type and the other attributes are missing. How do I save the extract in the same schema as the original file?

Write each column of EXCEL Sheet to seperate XML File

Hello I have a process in which I use FME to take a name from a Table, create a URL (like this "https://SERVER.XX_WFS_NAME?service=WFS&REQUEST=GetCapabilities") out of the name and download the coontent (XML) of that URL. Then a table is built out of that with 3 columns Name, URL and XML and ~300 rows. What I would like now is instead of one Excel file with 300 rows I would like to have 300 XML files preferablly with the tablename for each XML file as filename. I am quite new to FME so I tried out several writers but maybe you have a solution for me. An I currently use FME Workbench 2017 on Win10.CheersHannes

michiedemContributor

Unable to merge pdf's by name

I have two folders with PDF's with the same name. I need to merge the pdf's in folder A with the pdf's in folder B when they have the same name and I can't get it to work in any way. I now have this workbench ( I need a stringreplacer due to errors in file names): The output will not open with acrobat reader. I get an error saying thete is not enough information for drawing a picture. When I open the PDF in a browser it will open, but:- the first page is empty- Some parts of the PDF's are blocked with a black block: (note: this is the exact output, I did not block anything) My questions:- How do I merge teh pdf's?- How do I get an export that will open in acrobat reader?

alfonsContributor

Powerlines from Lidar

Hello, I have a LIDAR test data set, where I am trying to determine the power lines. These are currently in class 0 (unclassified). My first approach now is to select all points with a certain height above ground (and class 0). If the classification 0 is possible without problems, I unfortunately fail because of the classification of the points with a certain height above ground. For this purpose I have calculated a grid with the points of class Ground and the SurfaceModeller and then I check if the points of class 0 are on the grid height. If this is not the case, I continue to use them - but that is not possible.Another problem (which I haven't investigated yet) is, how do I convert the selected points into a vector?Is there another approach to extract (power) cables from lidar data?

aguanContributor

How to connect to ArcGIS Online in FME desktop?

I am new to FME vs AGOL. I want to use FME to update an AGOL hosted feature layer. Based on this article https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/arcgisonlinefeatures/arcgisonlinefeatures.htm, I created an app on our organizational AGOL using my enterprise single-sign-on, and registered the app to have an App ID and secrete key. But where I use them to connect to AGOL in FME? I don't see any place in the "ESRI ArcGIS Online Feature Service" writer. See attached. I am using FME desktop 2019.2.

Converting GML to shapefile

Hi, I would like to convert GML files into shapefiles using FME but have no idea how to do this. Could someone tell me where I could find instructions for this? Many thanks.

gogopotter90Contributor

How could i write the exceded rows from oracle file to excel file each part in different sheets

How could i writ the excedded rows from oracle to excel filesif it is not enough in one sheet can i write all data ins the oracle file to different sheet and eaxch sheet has part of the data from Oracle file till the data finished .Is it possible or which another format could i write the exceeded rows from oracle fiels to Thanks for any help

1
...
71
72
73
74
75
76
77
...
269

Page 74 / 269

Badge winners

ainohellehas earned the badge Welcome Back
otto-fghas earned the badge Welcome Back
bwallishas earned the badge Welcome Back
bwnhas earned the badge Expert (Silver)
martijndielemanhas earned the badge FME Form Basic Training

Show all badges

29,733: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK