HaaS - Hadoop as a Service
Installing a Hadoop cluster has never been so easy.
How to use
Install HaaS
gem install haas
Configure your environment with your AWS account
Get your AWS key and secret.
Set the two environment variable AWS_KEY and AWS_SECRET.
Launch
haas --launch
Optional parameters
| Option | Description | Default |
|---|---|---|
| --nb-instances | The number of instances you want to have in your cluster. | 5 |
| --instance-type | The EC2 instance type. | m3.large |
| --aws-region | The AWS region to launch the instances. | us-east-1 |
Stop the cluster
haas --terminate
Known issues and limitations
Cloud Provider
HaaS is working only with AWS. If you need another cloud provider create an issue about it.
AWS Limitations
EC2 Limits
By default, you can launch only 20 instances per region on AWS. This tool will check if you have enough instances available before launching a cluster. If you need more, you can increase your EC2 limit here.
Hadoop distribution
Only the HortonWorks distribution is currently supported. If you want to have another distribution supported, feel free to submit a pull request or an issue.
Contributing
If you wish to contribute on this gem:
- Fork the repository on Github
- Create a named feature branch (like
add_component_x) - Write your change
- Write tests for your change (if applicable)
- Run the tests, ensuring they all pass
- Submit a Pull Request using Github
License and Authors
Author: Julien Pellet
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.