issue_comments

Another route would be something like creating a datasette IPython magic for notebooks to take a dataframe and easily render it as a datasette. You'd need to run the app in the background rather than block execution in the notebook. Related to that, or to publishing a dataframe in notebook cell for use in other cells in a non-blocking way, there may be cribs in something like https://github.com/micahscopes/nbmultitask .

In terms of integration with pandas, I was pondering two different ways datasette/csvs_to_sqlite integration may work:

• like pandasql, to provide a SQL query layer either by a direct connection to the sqlite db or via datasette API;
• as an improvement of pandas.to_sql(), which is a bit ropey (e.g. pandas.to_sql_from_csvs(), routing the dataframe to sqlite via csvs_tosqlite rather than the dodgy mapping that pandas supports).

The pandas.publish_* idea could be quite interesting though... Would it be useful/fruitful to think about publish_ as a complement to pandas.to_?

I think there is a useful way forward here though: the image size may be limited to 100MB, but once the instance launches it gets access to a filesystem with a lot more space than that (possibly as much as 15GB given my initial poking around).

So... one potential solution here is to teach Datasette to launch from a smaller image and then download a larger SQLite file from a known URL as part of its initial startup.

Combined with the ability to get Now to always run at least one copy of an instance this could allow Datasette to host much larger SQLite databases on that platform while playing nicely with the Zeit v2 platform.

See also https://github.com/zeit/now-cli/issues/1523

I've been thinking a bit about ways of using Jupyter Notebook more effectively with Datasette (thinks like a publish_dataframes(df1, df2, df3) function which publishes some Pandas dataframes and returns you a URL to a new hosted Datasette instance) but you're right, Jupyter Lab is potentially a much more interesting fit.

I think you need to register a domain name you own separately in order to get a non-IP address address? https://www.digitalocean.com/docs/networking/dns/

This works now! The 0.25.1 release was the first release which successfully pushed to Docker Hub: https://hub.docker.com/r/datasetteproject/datasette/tags/

Here's the log from the successful Travis release job: https://travis-ci.org/simonw/datasette/jobs/450714602

That would be ideal, but you know better than me whether the CSV streaming trick works for custom SQL queries.

This is a good idea. Basically a version of this bug but on the custom SQL query page:

This would be fantastic - that tutorial looks like many of the details needed for this.

Do you know if Digital Ocean have the ability to provision URLs for a droplet without you needing to buy your own domain name? Heroku have https://example.herokuapp.com/ and Zeit have https://blah.now.sh/ - does Digital Ocean have an equivalent?