Ray Slakinski c88a6b6ae7 | ||
---|---|---|
code | ||
nasa | ||
viz | ||
.gitignore | ||
README.md | ||
manage.py | ||
run.sh |
README.md
nasa
nasa hackathon
Notes
https://github.com/nasa/w10n-reinvent
GIT REPO!!!! git@github.com:rays/nasa.git
Services: Identify new files added Convert new file to
API? Web Front End Push notifications email IM SMS
To Do Amazon Credentials/Setup Checkout github code and analysis Analysis Data Set How to distribute Data Set Setup AWS Account
Questions How often does the data set change? Is this something we care about for this challenge? Historical data is very important, and will be additive How quickly to return a response? Where to put code? Do we want to use the provided AMI? Prefered Operating System Anything Linux
Examples Is a volcano active in a given location Notify when a location wind hits 15 knots
Amazon Technologies Elastic Storage?
https://s3.amazonaws.com/chrisb/hackathon.html Details of Nasa/JPL requirements https://github.com/nasa/w10n-reinvent
Djaongo Stack Instance for frontend ec2-xxxx-xxxxx-xxx.us-west-2.compute.amazonaws.com
Talk to the NASA devs https://w10nreinvent.hackpad.com/
NetCDF/HDF libraries - http://www.unidata.ucar.edu/software/netcdf/ Interfaces and bindings - http://www.unidata.ucar.edu/software/netcdf/software.html
Geospatial Indexing on DynamoDB - http://aws.amazon.com/about-aws/whats-new/2013/09/05/announcing-amazon-dynamodb-geospatial-indexing/
Architecture suggestion: CDF data -> Elastic MapReduce -> DynamoDB (for Geospatial data)
Django EC2 Instance http://stackoverflow.com/questions/1638752/how-to-setup-django-website-in-amazon-ec2-hosting Simple: http://www.philroche.net/archives/simple-django-install-on-amazon-ec2/
Django/Redshift https://github.com/binarydud/django-redshift pysocpg2 >= 2.5 django 1.5
CDF data (on S3) -> Elastic MapReduce -> RedShift -> JPL visualizations (http://nasa.github.io/w10n-reinvent/slides/html5.html#basics)
REDSHIFT
endpoint: nasa.xxxxxxxxxx.us-east-1.redshift.amazonaws.com
CSV Schema for Redshift <time (epoch?), ,, <z (maybe null)>, <data (json blob)>
Contributors:
Adam Boyers Gregory Sterling Ray Slakinski Tarun Agrawal