auto conversion of data types?

[ttomasz]

I have a dataset in big query table where column type is string but when loaded into dekart it becomes float. Since dataset contains strings that are not numbers (e.g. 'L702') they become NaNs and values are lost.

Does dekart try to change the data types based on some sample of data? Is there a way to override that behaviour?

[delfrrr]

@ttomasz hey this is kepler.gl behaviour. It guessing types by first row (from top of my head) 😔.

Common work-around is to apply sorting.

[delfrrr]

I will be upgrading Dekart to newer versions and evaluating moving Apache arrow which should resolve scalar type problem fundamentally.

[ttomasz]

@ttomasz hey this is kepler.gl behaviour. It guessing types by first row (from top of my head) 😔.

Common work-around is to apply sorting.

Wow that kind of sucks. I guess I can prepend some character in the query to the field to make it extra clear to kepler that just because something has digits does not mean it's a number. Thanks for a very fast answer.