100 lines
2.1 KiB
Markdown
100 lines
2.1 KiB
Markdown
nasa
|
|
====
|
|
|
|
nasa hackathon
|
|
|
|
|
|
Notes
|
|
=====
|
|
|
|
https://github.com/nasa/w10n-reinvent
|
|
|
|
GIT REPO!!!!
|
|
git@github.com:rays/nasa.git
|
|
|
|
|
|
Services:
|
|
Identify new files added
|
|
Convert new file to <format>
|
|
|
|
API?
|
|
Web Front End
|
|
Push notifications
|
|
email
|
|
IM
|
|
SMS
|
|
|
|
To Do
|
|
Amazon Credentials/Setup
|
|
Checkout github code and analysis
|
|
Analysis Data Set
|
|
How to distribute Data Set
|
|
Setup AWS Account
|
|
|
|
Questions
|
|
How often does the data set change?
|
|
Is this something we care about for this challenge?
|
|
Historical data is very important, and will be additive
|
|
How quickly to return a response?
|
|
Where to put code?
|
|
Do we want to use the provided AMI?
|
|
Prefered Operating System
|
|
Anything Linux
|
|
|
|
Examples
|
|
Is a volcano active in a given location
|
|
Notify when a location wind hits 15 knots
|
|
|
|
Amazon Technologies
|
|
Elastic Storage?
|
|
|
|
|
|
https://s3.amazonaws.com/chrisb/hackathon.html
|
|
Details of Nasa/JPL requirements
|
|
https://github.com/nasa/w10n-reinvent
|
|
|
|
|
|
Djaongo Stack Instance for frontend
|
|
ec2-xxxx-xxxxx-xxx.us-west-2.compute.amazonaws.com
|
|
|
|
Talk to the NASA devs
|
|
https://w10nreinvent.hackpad.com/
|
|
|
|
|
|
NetCDF/HDF libraries - http://www.unidata.ucar.edu/software/netcdf/
|
|
Interfaces and bindings - http://www.unidata.ucar.edu/software/netcdf/software.html
|
|
|
|
Geospatial Indexing on DynamoDB - http://aws.amazon.com/about-aws/whats-new/2013/09/05/announcing-amazon-dynamodb-geospatial-indexing/
|
|
|
|
Architecture suggestion: CDF data -> Elastic MapReduce -> DynamoDB (for Geospatial data)
|
|
|
|
Django EC2 Instance
|
|
http://stackoverflow.com/questions/1638752/how-to-setup-django-website-in-amazon-ec2-hosting
|
|
Simple: http://www.philroche.net/archives/simple-django-install-on-amazon-ec2/
|
|
|
|
Django/Redshift
|
|
https://github.com/binarydud/django-redshift
|
|
pysocpg2 >= 2.5
|
|
django 1.5
|
|
|
|
CDF data (on S3) -> Elastic MapReduce -> RedShift -> JPL visualizations (http://nasa.github.io/w10n-reinvent/slides/html5.html#basics)
|
|
|
|
REDSHIFT
|
|
|
|
endpoint: nasa.xxxxxxxxxx.us-east-1.redshift.amazonaws.com
|
|
|
|
|
|
CSV Schema for Redshift
|
|
<time (epoch?), <lat>,<lon>, <z (maybe null)>, <data (json blob)>
|
|
|
|
http://pomegranate.nasa.gov/
|
|
|
|
Contributors:
|
|
|
|
Adam Boyers
|
|
Gregory Sterling
|
|
Ray Slakinski
|
|
Tarun Agrawal
|
|
|
|
|