Cloud Infrastructure: Unit 3 - Cloud Platforms and Standards, Study notes of Information Technology

Download Cloud Infrastructure: Unit 3 - Cloud Platforms and Standards and more Study notes Information Technology in PDF only on Docsity!

Cloud Infrastructure

Unit 3: Cloud Plat forms and Standards

Faculty Name : Ms. Priyanka Shinga

Index

Lecture : Amazon web services: Compute services

Lecture : Storage Services, Communication Services,

Additional services

Lecture : Google App Engine

• Cloud computing allows end users and developers to leverage large distributed computing infrastructures.
• This is made possible thanks to infrastructure management software and distributed computing platforms offering on-demand compute, storage, and on top of these, more advanced services.
• There are several different options for building enterprise cloud computing applications or for using cloud computing technologies to integrate and extend existing industrial applications.

Amazon Web Services ecosystem

• Amazon machine images (AMIs)
• Amazon MachineImages (AMIs) are templates from which it is possible to create a virtual machine.
• They are stored in Amazon S3 and identified by a unique identifier in the form of ami- xxxxxx and a manifest XML file.
• An AMI contains a physical file system layout with a predefined operating system installed.
• These are specified by the Amazon Ram disk Image (ARI, id: ari-yyyyyy) and the Amazon Kernel Image (AKI, id: aki-zzzzzz), which are part of the configuration of the template.
• AMIs are either created from scratch or “bundled” from existing EC2 instances.
• A common practice is to prepare new AMIs to create an instance from a preexisting AMI, log into it once it is booted and running, and install all the software needed.
• Using the tools provided by Amazon, we can convert the instance into a new image.
• Once an AMI is created, it is stored in an S3 bucket and the user can decide whether to make it available to other users or keep it for personal use.
• Finally, it is also possible to associate a product code with a given AMI, thus allowing the owner of the AMI to get revenue every time this AMI is used to create EC2 instances.

1. Compute services

• EC2 environment
• EC2 instances are executed within a virtual environment, which provides them with the services they require to host applications.
• The EC2 environment is in charge of allocating addresses, attaching storage volumes, and configuring security in terms of access control and network connectivity.
• By default, instances are created with an internal IP address, which makes them capable of com- municating within the EC2 network and accessing the Internet as clients.

• Advanced compute services
• AmazonWeb Servicesprovide more sophisticated servicesthat allow the easy packaging and deploying of applications and a computing platform that supportsthe executionof MapReduce-basedapplications.

a) AWS Cloud Formation

• CloudFormation is an infrastructure service.
• It lets you create templates that describe the AWS services that you want.
• Then, it handles the config and provisioning of the resources described in the template.
• It makes it easier because you do not have to configure the resources individually
• CloudFormation helps to handle the dependencies between the resources.

c) Amazon Elastic MapReduce

• (Amazon EMR) is a web service that makes it easy to quickly and cost-effectively process vast amounts of data.
• is the industry-leading cloud big data platform for processing vast amounts of data using open source tools such as Apache Spark, Apache Hive, Apache HBase, Apache Flink, Apache Hudi, and Presto.
• makes it easy to set up, operate, and scale your big data environments by automating time-consuming tasks like provisioning capacity and tuning clusters and uses Hadoop, an open source framework, to distribute your data and processing across a resizable cluster of Amazon EC2 instances.
• is used in a variety of applications, including log analysis, web indexing, data warehousing, machine learning, financial analysis, scientific simulation, and bioinformatics.

2. Storage services (Core Sevvices)

• S3 key concepts (Amazon Simple Storage Service)
• Amazon Elastic Block Store
• Amazon ElastiCache
• Structured storage solutions
• Amazon CloudFront

• Amazon Elastic Block Store
• AmazonElastic Block Store (EBS)is an easy to use, high performance block storageservicedesignedfor use with AmazonElasticComputeCloud (EC2) for both throughput and transaction intensiveworkloadsat any scale.
• A broad range of workloads, such as relational and non-relational databases, enterpriseapplications, containerizedapplications, big data analytics engines, file systems,and media workflows are widely deployedon AmazonEBS.
• They accommodate up to 1 TB of space and are accessedthrough a block deviceinterface, thus allowing usersto format them accordingto the needsof the instancethey are connectedto (raw storage,file system,or other).

• Structured storage solutions -Enterprise applications quite often rely on databases to store data in a structured form, index and perform analytics against it. -Amazon provides applications with structured storage services in three different forms: i) preconfigured EC2 AMIs- are predefined templates featuring an installation of a given database. Available AMIs include installations of IBM DB2, Microsoft SQL Server, MySQL, Oracle,PostgreSQL, Sybase andVertica.

ii) Amazon Relational Data Storage (RDS)-RDS is relational database service that relies on the EC2 infrastructure and is managed by Amazon. Developers do not have to worry about configuring the storage for high availability, designing failover strategies, or keeping the servers up-to-date with patches. Two key advanced features of RDS are multi-AZ deployment and read replicas.

iii) Amazon Simple DB- AmazonSimpleDBis a light weight, highly scalable and flexible data storage solution for applications that do not require a fully relational model for their data. Simple DB provides support for semi structured data

• Amazon CloudFront
• CloudFront is an implementation of a content delivery network on top of the Amazon distributed storage infrastructure.
• It leverages a collection of edge servers strategically located around the globe to better serve requests for static and streaming Web content so that the transfer time is reduced as much as possible.
• AWS provides users with simple Web service APIs to manage CloudFront.
• To make available content through CloudFront, it is necessary to create a distribution. This identifies an origin server, which contains the original version of the content being distributed and it is referenced by a DNS domain under the Cloudfront.net domain name.
• CloudFront is designed to optimize the distribution of very popular content that is frequently downloaded, potentially from the entire globe and not only the Amazon network.