Merge branch 'master' of github.com:rays/nasa
This commit is contained in:
commit
82a71ea3a1
88
README.md
88
README.md
@ -2,3 +2,91 @@ nasa
|
|||||||
====
|
====
|
||||||
|
|
||||||
nasa hackathon
|
nasa hackathon
|
||||||
|
|
||||||
|
|
||||||
|
Notes
|
||||||
|
=====
|
||||||
|
|
||||||
|
https://github.com/nasa/w10n-reinvent
|
||||||
|
|
||||||
|
GIT REPO!!!!
|
||||||
|
git@github.com:rays/nasa.git
|
||||||
|
|
||||||
|
|
||||||
|
Services:
|
||||||
|
Identify new files added
|
||||||
|
Convert new file to <format>
|
||||||
|
|
||||||
|
API?
|
||||||
|
Web Front End
|
||||||
|
Push notifications
|
||||||
|
email
|
||||||
|
IM
|
||||||
|
SMS
|
||||||
|
|
||||||
|
To Do
|
||||||
|
Amazon Credentials/Setup
|
||||||
|
Checkout github code and analysis
|
||||||
|
Analysis Data Set
|
||||||
|
How to distribute Data Set
|
||||||
|
Setup AWS Account
|
||||||
|
|
||||||
|
Questions
|
||||||
|
How often does the data set change?
|
||||||
|
Is this something we care about for this challenge?
|
||||||
|
Historical data is very important, and will be additive
|
||||||
|
How quickly to return a response?
|
||||||
|
Where to put code?
|
||||||
|
Do we want to use the provided AMI?
|
||||||
|
Prefered Operating System
|
||||||
|
Anything Linux
|
||||||
|
|
||||||
|
Examples
|
||||||
|
Is a volcano active in a given location
|
||||||
|
Notify when a location wind hits 15 knots
|
||||||
|
|
||||||
|
Amazon Technologies
|
||||||
|
Elastic Storage?
|
||||||
|
|
||||||
|
|
||||||
|
https://s3.amazonaws.com/chrisb/hackathon.html
|
||||||
|
Details of Nasa/JPL requirements
|
||||||
|
https://github.com/nasa/w10n-reinvent
|
||||||
|
|
||||||
|
|
||||||
|
Djaongo Stack Instance for frontend
|
||||||
|
ec2-xxxx-xxxxx-xxx.us-west-2.compute.amazonaws.com
|
||||||
|
|
||||||
|
Talk to the NASA devs
|
||||||
|
https://w10nreinvent.hackpad.com/
|
||||||
|
|
||||||
|
|
||||||
|
NetCDF/HDF libraries - http://www.unidata.ucar.edu/software/netcdf/
|
||||||
|
Interfaces and bindings - http://www.unidata.ucar.edu/software/netcdf/software.html
|
||||||
|
|
||||||
|
Geospatial Indexing on DynamoDB - http://aws.amazon.com/about-aws/whats-new/2013/09/05/announcing-amazon-dynamodb-geospatial-indexing/
|
||||||
|
|
||||||
|
Architecture suggestion: CDF data -> Elastic MapReduce -> DynamoDB (for Geospatial data)
|
||||||
|
|
||||||
|
Django EC2 Instance
|
||||||
|
http://stackoverflow.com/questions/1638752/how-to-setup-django-website-in-amazon-ec2-hosting
|
||||||
|
Simple: http://www.philroche.net/archives/simple-django-install-on-amazon-ec2/
|
||||||
|
|
||||||
|
Django/Redshift
|
||||||
|
https://github.com/binarydud/django-redshift
|
||||||
|
pysocpg2 >= 2.5
|
||||||
|
django 1.5
|
||||||
|
|
||||||
|
CDF data (on S3) -> Elastic MapReduce -> RedShift -> JPL visualizations (http://nasa.github.io/w10n-reinvent/slides/html5.html#basics)
|
||||||
|
|
||||||
|
REDSHIFT
|
||||||
|
|
||||||
|
endpoint: nasa.xxxxxxxxxx.us-east-1.redshift.amazonaws.com
|
||||||
|
|
||||||
|
|
||||||
|
CSV Schema for Redshift
|
||||||
|
<time (epoch?), <lat>,<lon>, <z (maybe null)>, <data (json blob)>
|
||||||
|
|
||||||
|
http://pomegranate.nasa.gov/
|
||||||
|
|
||||||
|
|
||||||
|
Reference in New Issue
Block a user