User:NamKluge0989

From EU COST Fin-AI
Jump to navigation Jump to search

Not many domains have popularity as cloud computing has in recent times. So it's no secret that cloud computing adoption is on Rice as you guys might have known Microsoft Azure is one of the best and leading cloud service providers and it certainly makes it to the list of top cloud computing skills. That one must have if you want to make a career in this domain then you have landed at right. Place hi, I welcome you all to this full course on Microsoft Azure, which not only talks about is your fundamentals, but will also take you deep at conceptual levels before we get into details. Let's look at our agenda for today for better understanding and ease of learning entire course is divided into multiple modules. First module introduction to cloud is about what exactly cloud computing is different kind of deployment and service models in cloud computing second model is about as your fundamentals. Well in this module we will learn how to create a short Street our account and we'll also discuss one of the code Computing service, which is Usher virtual machine next up in the third module will discuss as your storage services and database features in detail. Fourth module is about different network services offered by assured in here will discuss as your virtual Network and related Concepts like subnets security groups and many more in fifth module. We will learn how to secure your Access to your resources using identity and access Management Services like Azure active directory six module is all about is your develops in this module. We'll learn how to simplify and accelerate entire divorce process using Azure develop services, like a sewer pipeline as your boards Etc in seventh module will talk about different services offered by Usher when you are dealing with current training Technologies, like machine learning a iot and Manny, Moe also will be comparing after sure with other leading service providers like AWS and gcp final module is mostly korea-related in this module. We'll discuss most frequently Asked interview questions in Azure interviews will also discuss roles and responsibilities job Trends and skills that you should have to ease your interview. Thank you everyone while you are at it. Please do not forget to subscribe at Eureka YouTube channel and hit the Bell icon to stay updated with current trending Technologies. So let us move further and quickly take a look at today's agenda first firstly, I would be discussing the basics of cloud as in why it is needed and what it is exactly. I would also discuss the different models that cloud has to offer to you like it's service models and also its deployment models and also discuss the different Cloud providers that are there in the market and finally I would finish things off with the demo part. I hope this agenda is clear to all of you firstly let's understand why Cloud to understand this So we need to understand the situation that existed before Cloud came into existence. So what happened back then and firstly in order to host a website, you have to buy a stack of servers and we all know that servers are very costly. So that meant we ended up paying a lot of money next was the issue of traffic. Now as we all know if you are hosting a website we are dealing with traffic that is not constant throughout the day and that meant more pain we would understand that as we move further and the other thing was monitoring and maintaining your servers. Yes, this is a very big problem now all these issues. They led to certain disadvantages. What are those as I mentioned servers are very costly. Yes. The setup was again costly and thus you ended up paying a lot of money and there were other factors contributing to this point. Let's discuss those as well. One troubleshooting was a big issue since you're dealing with a business. Your Prime Focus is on taking good decisions so that your business does well, but if you end up troubleshooting problems, Soare you focus more on infrastructure related issues. Then you cannot focus more on your business. And that was a problem. So either you had to do multitasking or you have to hire more people to focus on those issues thus again you ended up being more money as I've discussed the traffic on a website is never constant. And since it varies you are not certain about its patterns. Say, for example, I need to host a website and for that what I decided I am reserving to petabytes of total memory for my usage based. On the traffic but as the traffic, where is there would be times when the traffic is high and my whole to petabytes of data is consumed or space is consumed Roger. But what if the traffic is very low for certain hours of the day. I'm actually not utilizing these servers. So I end up paying more money for the servers than I should be. So yes upscaling was an issue. So all these things were an issue because we were paying more money. We do not have sufficient time to take our decisions properly. There was ambiguity. There was more trouble. All monitoring and maintaining all these resources and apart from that one important point which we need to consider is the amount of data that is being generated now and that was being generated then then it was okay, but nowadays if you take a look at it the amount of data that is generated is huge and this is another reason why Cloud became so important. Yeah, as of mentioned the data now, we all know that everything is going online these days and what that means is we shop online we buy food online. We do almost everything. What is required as an whatever information we need we get everything online your bookings and reservations. Everything can be taken care of that means we have a lot of data that is being generated these days and this is Digital Data back in those times. We were communicating through verbal discussions and all those things so through paperwork and that was a different data to maintain since everything is moving on cloud or moving online. The amount of data that we have is used these days and then when you have this huge amount of data Are you need a space where you can actually go ahead and maintain this data? So yes again, there was a nude of this piece and all these issues that is your cost. You're monitoring your maintenance providing sufficient space. Everything was taken care by Cloud. So let us try to understand what this cloud is exactly. Well think of it as a huge space that is available online for your usage. This is a very generic definition to give you to be more specific. I would be seeing that think of it as a collection of data centers now. Yes, it does again at a place where you store your data or you host applications basically, so when you talk about these data centers, they were already existing. So what did Cloud do differently? Well, what cloud did was it made sure that you are able to orchestrate your various functionings applications managing your resources properly by combining all these data centers together through a network and then providing you the control to use this resources and to manage them properly to make it even more simpler. I would say there was a group of people or organizations. Basically that went ahead and bought these servers these compute capacities storage places compute services and all those things and they have their own channel or Network. All you have to do was go ahead and rent those resources only to the amount you need it and also for the time that you needed. So yes, this is what cloud did it let you rent the services that you need and you Only those services that you need so you ended up paying for the services that you rented and you ended up saving a lot of money. The other thing is these service providers. They take care of all the issues like your security your underlying infrastructures and all those things. So you can freely focus on your business and stop worrying about all these issues. So this is what cloud is in simple words. It's a huge space which has all these services available and you can just go ahead and pick and render services that you want to use. So what is cloud computing? Well, I've already discussed that just to summarize it I would say it is nothing but an ability or it is a place where you can actually store your data. You can process it and you can access it from anywhere in the world. Now. This is an important Point say for example, you decide to choose a reason for infrastructure somewhere in u.s. You can certain maybe China or maybe in India and you can still have access to all your resources that is there in u.s. All you need is a good internet connection. So that is what cloud does. Makes the world accessible it lets you have your applications wherever you want to and manage them the way you want to so this was about cloud computing guys. Next we would be discussing different service models. Now you need to understand one thing you are being offered cloud services the platform to use your services or your applications basically, but then different people have different requirements. There are certain people who just want to consume a particular resource or there's certain people who actually want to go ahead and create The View. Own applications great the own infrastructure and all those things. So based on these needs we have particular service models that is your Cloud providers provide you with a particular model which suits your needs. So let us try to understand these models one by one we have these three models that is your iaas your paas and your saas. I would be discussing them in the reverse order. That is I would be talking about saas first and then I would go upwards so let us start with saas or sad. SAS is nothing but a software-as-a-service. Now what happens here is basically you are just consuming a service which is already being maintained and handled by someone else to give you a valid example. We have a Gmail. All you do is you send mail to people and you receive mails and whatever functionality you do is you just use the service that is there. You do not have to maintain it. You do not have to worry about up scaling down scalings security issues and all those things. Everything is taken care by Google say for example But yard email is what I'm talking about Google manages everything here. So all you have to worry about is consuming that service now this model is known as software as a service that is saas. Next we have passed that is platform as a service now here you are provided with a platform where you can actually go ahead and build your own applications to give you an example. We have our Google app engine. Now when you talk about Google app engine, what you can do is you can go ahead and you can create your own applications and you can put Put it on Google app engine so that others can use it as well. So in short you are using the platform to create your own applications, and lastly we have iaas that is infrastructure as a service. Now. What do I mean by this? Well, the whole infrastructure is provided to you so that you can go ahead and create your own applications. That is an underlying structure is given to you based on that. You can go ahead and choose your operating systems the kind of Technology you want to use on that platform the applications you want to build an old those things. So that is what an IAB S is infrastructure-as-a-service basically, so these were the different models that I wanted to talk about. So let us move further and discuss the next topic. That is the different deployment models that are there. Now when you talk about deployment models, you can also call them as different types of clouds that are there in the market we have these three types. That is your public Cloud your private cloud and your hybrid Cloud. Let us try to understand these one by one now as the name suggests the public Cloud it's available to everyone you have a A service provider who makes these services or these resources available to people worldwide through the internet. It is an easy and very inexpensive way of dealing with the situation because all you have to do is you have to go ahead and rent this cloud and you're good to use and it is available publicly. Next. We have the private Cloud now. This is a little different here. You are provided with this service and you can actually go ahead and create your own applications. And since it's a private Cloud you're protected by a firewall. Add wall and you do not have to worry about various other issues that are there at hand and next. We have our hybrid Cloud now. It is a combination of your private cloud and your public Cloud say, for example, you can go ahead and build your applications privately you can use them. You can consume them you can use them efficiently. When you sense that peak in your traffic. You can actually move it to public that is you can move it to the public cloud and even others can have access to it and they can use it. So these are the three basic deployment models that are there for you. Exposure or your usage rather and you can go ahead and use those as well. I hope this was clear to all of you. So let us move further and try to understand the next topic that has different Cloud providers that are there in the market. Now as I've mentioned what happened was since Cloud came into existence quite a few people went ahead and they bought their own infrastructure and now they rent the services to other people and when you talk about this infrastructure, they're quite a few people out there who are actually providing these cloud services to different people across the globe now when you talk about These Cloud providers. The first thing that should come to your mind is Amazon web services because it is highly popular and it leaves other Cloud providers way behind. The reason I'm saying this is the numbers that talk about Amazon web services to give you an example. If you talk about its compute capacity. It is six times larger than all the other service providers that are there in the market say for example, if you talk about the other service providers in the market if the compute capacity combined was ex-army Has on web services alone gives you a capacity of 6 x which is huge apart from that. It's flexible pricing and various other reasons. That is the services it provides and all those things. It is rightly a global leader and the fact that it had a head start that is it started way before many other services that are there in the market. It actually gained popularity. And now we see quite a few organizations going ahead and using Amazon web services apart from that. We have Microsoft Azure, which is a Microsoft product and we all All that when Microsoft decides to do something they expect that they kill all the competition that is there in the market. It is still not in terms with Amazon web services or few other service providers that are than the market but not very neck to neck but it is probably the second best when you talk about Amazon web services or the cloud service providers in the market. So, yep, it has a lot of catching up to do when you compare it with Amazon web services, but it is still a very good cloud service provider that is there in the market. Then we have something called as Google Cloud platform again a very Very good cloud provider in the market. Now. Why am I saying this? We all know the infrastructure that Google has to offer to you. It has one of the best search engine that is then the market and the amount of data they deal with every day is huge. So they are the Pioneers when you talk about big data and all those things and they know how to actually handle this amount of data and how to have an infrastructure that is very good. That is why they have a very good facility and that leads to it being one of the cheapest service providers in the market. Yes, there are Features that DCP offers which are better, even than Amazon web services when you talk about its pricing and the reason for it is it has various other services that are there water does is it helps you optimize various costs how it uses analytics and various other ways by which it can optimize the amount of power you use and that leads to less usage of power. And since you are paying less for power that is provided as a paying less for power you end up paying less for your services as well. So that is why It is so cost efficient. Then the other service providers that is we have digital ocean. We have to remark we have IBM which is again very popular. But that is a discussion for some other time. As far as the service providers go. These are the major ones that as we have Amazon web services. We have Microsoft Azure, we have DCP which are talked about a lot. This was about the basic Cloud providers and the basic intro which I wanted you all to have. I hope you all are clear with whatever Concepts we've discussed in time. So let us move further and switch into the demo. Let us try to explore a few of these services or Cloud providers as in at least the introductory part. Okay. So what I'm going to do is I'm going to switch into the console basically where we can take a look at these Services one by one. So yes guys, what I've done is I've cornered and have logged into my AWS account now AWS provides you with a free tier and then they have the paid Services as well. Let's discuss these one by one first. I would talk about AWS then I will talk about gcp and to some extent I would also discuss a juror as well, but But let's focus on AWS for first one point, which I did not mention while going through the concepts was AWS provides you with a free tier. Now when I see a free tier, this is where you do not have to pay any upfront money. You can actually go ahead and have access to AWS services and see how they work and once you are confident and comfortable with them, you can actually go ahead and decide whether you want to buy those services or not. So yes, these services are made available to you for free for one complete Year. Yes. There are certain restrictions on it. But as long as you stay in those restrictions, you won't be Panting if you cross those restrictions. Yes in abuse will charge you now. How does AWS do that? Well, when you create an account, you have to give in your credit card details or debit card details, when you do that database will cut a lump sum amount from your account verify account and reinstate that amount back into your account so that none of your money is used but just a verification is done that this is your valid credit card or your debit card and once your 12 month free trial expires, then they would notify you that your free trial is over. Would you want to go ahead and continue using our services if you say yes, then they would charge meanwhile, they won't charge you so you can stay relaxed and you can actually go ahead and give you a credit card or debit card details, but just make sure that you set an alarm and once your free trial gets over you kind of either revoke your exes or go ahead and continue with the paid services that it abuse has to offer to you. So what does this re-tear has to offer to you? Basically, let's take a look at those. Well firstly we have compute Services when you talk about AWS and Name a few we have ec2. We have Lambda which are popular Services now easy to is something like a raw server where you can actually go ahead and post our websites and applications. It is very popular. And if you want to use it, it obvious gives you 750 hours per month for free. Then you have some service called as Amazon quick set which is basically an analytic service and I won't get into the details of what it does basically, but you have a space of 1 GB available to you that is nothing but spice capacity basically again, I won't get into the details because I want to Stick to the surface as far as the session goes, then you have other services like your database service, which is an RDS. You have your storage service, which is S3 Amazon Lambda. Now Lambda is another compute service which is similar to your ec2. But ec2 is more of a place where you can host a websites. Where as Lambda does not let you host a website. But yes, you can definitely go ahead and do a lot of background application work. When you talk about AWS Lambda apart from that database also provides with various videos that talk about how do you want to go ahead and get started with using this? Sosa's how to create an account how to create instances and all those things. So this was about the free tier let us kinda move further and see how the console looks like. You can actually go ahead and create your own instances. You can do a lot of things. So this is what the different services that a device has to offer to you. You have your compute Services developer tools machine learning and I'll takes storage database Services. You can actually go ahead and use these on your own you can go ahead and create certain instances here now once you click here oniy Easy to you get to see the number of instances that are active the security groups that are there the keep is that you have let us see or take a look at an instance. Basically. I would tell you how to create one. I won't create one myself because I have certain ones running already. I would just walk you through how the process works. When you click on that launch instance. It will give you options in what kind of an instance do you want to create so you can actually go ahead and pick the one that suits your need based on the OS you're using and stuff like that since I'm using a Windows. We'll be picking one for Windows and I would be using the one that is freely available to me or eligible for my free tier. So when I say select I see that a free tier eligible T2 micro instance is available to me. I can either click on this and directly go to the final step of creation, or I can take a step by step approach. That is if I want to modify it. I can go ahead and given these details as in the number of instances my purchasing options Network subnet auto-assign public IP and all those things. So let's click on next and we can also also put in these details, but I'm going to stick to the default decisions or the selections. You can also go ahead and configure your security groups. I would talk about that as well. Do not worry and finally it would say do you want to remove and launch it? Once you click on this you would have a new instance they would be couple of statistics and you'd have your instance available for use to give you an example take a look at this as you can see. I have two instances running and the security checks are done and I can actually go ahead and do a lot of things with it. I can actually go ahead I can connect to a server. Again have my security group security policies. And when you have an instance, you can do so many things for hosting a website and the other things that are there now, I just mentioned keep are values and I mentioned security groups. Now when you talk about the key pair it is nothing but an authentication process that lets you use your instance. It is a verification process. Basically it varies when you talk about using it on your Linux and using it on your Windows Windows, you would need it for an external login as far as when you talk about Linux you'll have To go ahead into your terminal and generate those SSH or your secure server Keys basically or secret selkies rather and then log into your website and then go ahead and use it on your server basically. So this is what happens. So that is something that you called as a keeper value when you talk about AWS a keeper value once created it is unanimous or it is not unanimous rather. It is primary to a particular instance and you should not lose it because if you do that instance becomes useless for you, so You have to make sure that once you create a key value pair that key value pair it stays with you and when you do try to connect to a server that keeper value or its value is available with you so that basically you can switch to your server and connect to it. And then you have something called as your security groups as well. Now if you come down here you can go ahead and set in your Security Group policies. Whatever. Those are you can create a new security group and you can just go ahead and add rules as in what kind of security policies you want. Say, for example, you have your HTTP https now if you're using Windows, you'll be needing our DP and those kinds of rules. You can go ahead and select a source you want to and accordingly you can set in your security rules. Once you create on click on create you'd be having your Security Group up and running for you and you can like stay assured that your so-called services are more than secure here. So yeah, this was about Amazon web services and how its interface looks like then you have something called as your gcp now gcp to has a free. The only difference is gcp gives you an a balanced amount as in say some amount of US Dollars and you can the services are paid services, but you can use this balance to go ahead and use those services. So it pans out to similar approach which aw stakes in but if you talk about their pricing, aw charges you on hourly basis, whereas your Google Cloud platform charges you and second basis. So it is more affordable. Say for example, you stop using a particular instance at two minutes. You'll be charged. Only for those two minutes, but if you stop using an instance for two minutes in AWS would be charged for a complete are so that is the difference between the two as far as logging in is concerned again, you'll be going ahead and giving in your credit card details here as well. The difference is here. You have to make sure that you do not enable your billing because once you do that, trust me, you're going to end up paying a lot of money because I accidentally left few instances open. The last time I logged in and I was charged Hefty live without me being noticed. When you see a button missing that enable billing make sure that you use it carefully because you do not want to be charged for something that you are not using. So when you talk about gcp this is how the interface looks like. You have all the services here as well there you had your computer services you have you have your compute engine basically and you can to come here and create your instances. You can click here and you can go ahead and go through the process of creating your instances, but I won't be creating an instance as far as you are gcp is concerned because I've given you a reason already. I'm happy working with AWS for now. This is your dashboard where you get in all the information as in whatever is happening as far as your account is concerned. So this is one of the accounts managed by a person I know who works with me and the certain projects which he has gone ahead and created. So it's the information for those details are the details for that project basically and then you have something called as your Microsoft Azure now, I won't log in and get into the details. But yeah it to provides you with similar services. So is this what about the different cloud? Riders that are then the market and I just wanted you all to have some understanding as in how do these things work? And what do these Services have to offer to you? I hope this is clear to all of you. Why a Microsoft is your why are you guys so interested in Microsoft with yard. Now one thing is that Microsoft is your is actually becoming pretty big. I mean the cloud leader on papers. It is AWS right now, but if you see the growth with that has been happening in the past few years Microsoft is your is actually coming out pretty big. Right? So and that is the reason if you look at this graph, there are the job opportunities for Azure has been on a rice and that is like this is the primary reason that you guys want to learn about Microsoft with your because obviously you want to make a career shift into the cloud industry, right and for that availability of jobs should also be a factor. And if you see the graph this graph is has actually been taken from indeed.com, right and as you can see the graph is rising. So if you see as 2014 it was around .01% in the mid in the late 2016. It's reached around .09 it came down to a fault. But then again it is at a right. So this is apartment that you see but if you take my advice because I have seen the industry as far as I know these jobs. Are going to increase multiples in the future as well. Right? It's not only restricted to is or if you talk about AWS if talk about any Cloud technology, it has become imperative for you to learn about Cloud because it is the thing everything in the next 10 or 15 years is going to be on the cloud right any company which is still on its own for my servers will move to the cloud one day or another because that is inevitable that Is something that has to happen and that is the reason it becomes very important for you guys to skill up to the cloud level right now talking about is your like I said, so jobs are increasing every day jobs are there for you? So what needs to be done from you guys is prepare for the exam. That is therefore Azure give that exam get the certification get hands-on experience and get the job. This is the course. This is the path that you should have for taking a cloud computing roll. Right having said that so that is this is the reason why we learning about Microsoft Azure today moving on. Let's understand what Microsoft is your is exactly so Microsoft is your is a growing locations through Microsoft's Global Network of data centers, right? So by using the Microsoft infrastructure, you build deploy and manage applications on the has your environment and Like as you're like I said, it's a cloud provider. It provides you the cloud services you're using those cloud services, but those cloud services are actually on the Microsoft infrastructure. And that is what you are paying them for right? So, this is what Microsoft Azure is all about guys. Now, let's see a use case now that is My Philosophy is that rather than doing all the theory first and then going on to the Practical I would like to follow the reverse approach, right? I would I'd like to begin from practicals because that is what your exam will be based on your exam will be based on real-life example that you based on real-life scenarios Lou based on what kind of Hands- On knowledge you have in your as your domain. All right, and that is the reason every session of ours will have a use case through which we will try to analyze how we can implement it in the cloud. Right? So this is your first use case. This is kind of simple guys. So please pay attention. So we are trying to make a website which is something like this. Right? So what happens here is you have a set of images and these images are actually being played in the background. And in this website, you have a functionality to upload more files to the cloud and once you do that those files will automatically be added in the slideshow and we'll start running. Alright, so this is our use case and we have to implement it on the cloud. So there are two stages in the way. We are going to take this use cage the first stages. We're going to apply pure logic, right? We are going to understand how we can actually deploy it on any cloud service right? Not only does your butt any Cloud platform if it is out there, how can we implement this use case? So let's see that first and after that once you have understood that will try implementing it in as your so first. Let's see how We will implement this in a general scenario by pure logic. So your user base will be accessing the internet right now when your user will try to access the website, he will enter the website name, right? So all of that traffic will come at this point, which is called a load balancer. Now, what is the load balancer a load balancer is basically a service which distributes your traffic equally among the server's running at that time. So say there are like five servers running your website then and if traffic is coming on to your servers that traffic will be distributed among those five servers by the load balancer. So the job of the load balancer is to distribute the traffic equally among the service, right? So this is what the load balancer is all about. So your user base from the Internet is trying to access your website. So the traffic comes to the load balancer and the load balancer separates or Segregated traffic into equal proportions and give it to the server's right. So once the traffic comes onto the server's the server's process the request and if you talk about our website, so our photos are actually stored on a file system, right? So whatever files you are uploading or whatever files are there, which are already been uploaded there on a file system, right? So it will access that file system for fetching those files, but our servers they don't know. What files do we want? Right? What is the like say, for example, I upload a file and before uploading the file. There were three pictures running in the background. So my server should know what are those three files that I have excess right? There should be a list of those files that the server has to play in the background. Now that list of files is actually stored in a database, right? So what my service will do is it will first get that list from the database right? And once it gets at least it will fetch that. List of files from the file system say there are around five files in the database. So my server will interpret the addresses of those files from the database and then it will call the file system and get those addresses or get those files from there and Fry to show that in this slideshow in the website. Now when we upload the file, what happens is first your database is updated, right? So whatever file is being uploaded to your servers, that file is Renamed according to whatever parameter you have set because it has to be unique. Right each file has to be identified with a unique name, right? So it renames that file to that unique name and then store it on the database once entry has been made on the database then it gets uploaded onto the file system. Right? So guys, this is the architecture of your application just as the logic that will be following today. So let's try to implement this architecture has your nose Understood how we can actually architect this use case in a general way. Right? Let's see how we can implement it in the has your environment. So in the Azure environment the servers that you're trying to implement is actually provided to you by a service called the app service. What is AB service will be discussing in the further slides. Then let's talk about the load balancer and auto-scaling. So the load balancer is actually implemented by the has your load balancer and auto-scaling, right? And having said that then we talked about the database. So database is the mySQL database that will be using in Azure and then you have the file system which is called blob storage in your what are these Services you might be confused. Okay. What is your load balancer? What is the app so is what is mySQL database? What is blob storage? Don't worry. I will explain everything to you in the coming few slides. So let's go ahead then. So these are the services that you'll be using in a jar. Let's go ahead and understand these Services one by one. So let's talk about the app service first. So the app service is basically a part of the compute domain. All right, and in the compute domain you have a lot of sources, but why are we using the app service? Let's understand that. So there are basically three kinds of services in the compute domain if you talked about in a very broad sense. The first service is called the virtual machine. Now. What is the virtual machine a virtual machine is just like a traditional computer. Now that you have in your in-house data house. It is a computer that is accessible to you and you can do anything with that computer where you have all the rights to that computer. All you have to do is basically what you will do with a virtual machine is you will say that I need this much RAM. I need this much storage and I need this much configuration. Please give me a computer. So as your will create that virtual machine for you, right and it will give you the IP address and the password for that machine. What you can do is by remote desktop connection. And you can enter that IP address and the password and you will be able to connect to that computer. Now, once you connect to that computer, it is your computer annoyed you have the access to the user interface. You can do anything on this computer. You can make it a website server. You can make it a worker to your environment. You can use it to for image processing right? You can do multiple things on a so I like you I might be doing on your server as well. Right? So this is what virtual machines is all about. You can configure it to Become anything. Our next service is called the app servers. So it is a basically an automated version of a virtual machine, but with limited possibilities when I say limited possibilities it is this service is actually very more focused. Right so app service. Basically, it doesn't give you the access to the user interface. All right, but that gives you more simple interface to deal with because if you want to host a website in virtual machine you would have To configure the virtual machine you would have to configure the firewalls. You would have to install the necessary software like say for example, you have a PHP website, right? So you would have to install PHP software on a virtual machine and then you would have to copy those your website files or the files that you have coded into a specific folder and then you would have testified the configuration for your firewall and everything. Right? So there were a lot of things that you had to do in your virtual machine with app service. You don't have to do anything. Then you just have to specify what language you want. Say, for example, I want a PHP website. So I'll select PHP. I'll do next then last me what kind of configuration of servers I want. I'll specify the configuration. I click next and that is it. My website will be deployed automatically. It will ask me to upload the files. I'll upload the files. It will automatically send it to whatever folder it is required and this done right? So this is the part of app service right? It is more automated because the Pitching machine everything had to be done manually, but with app service everything happens automatically. I just have to upload my files, right? So this is what app service is all about. So, like I said, so app service is basically used to deploy an application. All right, you cannot do anything else with it. You cannot use it to process a customized workload or something like that. You can just use it to deploy an application and that is why it is called an app service Right Moving On Let's Talk. Talk about functions of functions is basically a very new technology. It's called the server less architecture it basically what it does is you don't have to specify the configuration. You don't have to specify anything. You just have to upload your code and it executes it for you, but it will not deploy any application for you. For example, you want to host a website. It's not do that. It just does processing in the sense. It will only do background tasks for you. For example, if you Have let me take an example which uses both these Services. If you have say an application like Instagram, right? So user uploads His image on your application. And then your application has to store that image now before storing that image. Maybe you want to compress the image or you want to apply a filter to it or whatever, right? So from your application the file is uploaded. And now these many tasks have to be done if these tasks are actually configured in your code, which is Actually uploading the file as well. It will actually increase the overhead on the server which is hosting an application. But what we can do is the way things happen today is everything is distributed. Right? So from your application only the file will be uploaded. Once the file is uploaded. Right? The tasks will be the tasks like renaming the file or compressing the file applying the filters. Everything will be done using the functions. So the function will get invoked whenever the file. Is it uploaded using the app servers and the function will execute all the tasks that have to be done on that particular image this reduces the overhead on the server which is hosting your application. Right? And you have your background tasks will be implemented by a functions and then will be stored in the respective file system. Whatever you have coded your function to do right? So this is basically the difference. So recapping again virtual machine is basically a computer you can configure it to anything you can actually we use app servers in a virtual machine Mallory. For example, you want to deploy an application you can use it by configuring a virtual machine, right? You can also use it as a function your virtual machine that I mean to say as in you can configure it to only execute background tasks. But the thing is you have to configure everything manually. If you want an automated version you can go with app Service app Services used to deploy an application. Right? But if you are use case is not about deploying application you want to do some raw? Searching you might as well hop for functions, which is a service which is not used to deploy an application but is used to execute background tasks. All right, so guys a doubt and whatever we have discussed like we discussed virtual machine. We have discussed app service and we've discussed functions. All right. Like I said, we are using the app service why because we are deploying a website, right? So for deploying a website, I need apps away. So it cannot be done using functions can be done were doing virtual machines as well, but it will need a lot of manual work and our job is to make everything faster right cloud computing is all about speeding up things. The speed of implementing is increased right so I rather use an app service and upload my code on the Service and it will deploy the website from right it's that simple guys. Let's move on to the next topic of today's discussion, which is the blob storage. So the blob storage is basically the file system that you need to upload your files, right? You definitely need a file system. There is no alternative to this. Right. So your blob storage is the place where you will be storing your image files, but why did we choose the blob storage by not some other service from the storage to Maine? Let's discuss that. So in the storage domain basically, you have three kind of services you have more services well, but these are the three main services in the blob in the storage domain. You have the block storage. You have the Q storage and then you have the backup, right? So the block storage is like I said is a file system on which you can upload any kind of file, right? And that's about it. There is nothing more to blob storage. This is the thing next is Kyu storage Secure Storage is basically a queuing service whenever you have to synchronize tasks. For example process one has to be done before process to and process to help it to be done before process 3. So what you can do is you can bundle these tasks in a sequential Manner and you can add it to the queue storage. Right? What the queue storage will do is it will actually hold these tasks according to the sequence that you entered, right? And whenever the queue storage is accessed it will give them only the first task now the second task is the third task first. So the way It functions is like this say for example, like I said the image processing application. I want to rename file first there won't I want to add filters and then I want to store it on the file system. So these three tasks I will write it down and I will add it into the queue storage now. See these tasks will be done by my functions. All right. So what functions will do is it will try to interact with Q storage and last for a task, right? So Q storage will give the task to Functions in a very sequential manner in the sense that it will first give it the task to rename the file. So it will rename the file. Once that task is done. It will again try to xsq storage and then cute store has been given a task to filter the image or apply filter to the image, right then we'll apply a filter to the image will be done with that and then it will try to again the to storage and then it will see that okay now it has to store that file in a file system which is specified the code right and it will pick that task do it. It and be done in the first file and then it again XS Q storage in the process goes on. Right? So basically Q storage is used to give a sequential manner to the processes that are trying to execute having said that this is a work queue storage then comes back up. So backup is a service where in you can store your in frequently accessed data, right? What is your in frequently accessed data could be for example in my company. We take a record of everything right we take our Out of every class that we do we take a record of every query that you guys raised now save the classes that were taken say like 2 years ago, right and as obviously I cannot delete those classes because they have to be kept for record. But what is the point of keeping them on my life hard drive because my life hard drive is where I do. My current tasks, right? So rather than keeping it on my life hard drive I say, okay. Let me keep it in a CD or a pen drive and keep it somewhere where I can take it out when I actually need them. Right? So this is the concept of taking a backup now similarly. If you want to take a backup in as your say you have your virtual machine and you have stored a lot of files on your virtual machine, but you think okay. I don't need these files anymore. Or maybe I don't need you file it as of now, I might them need them later. So why do spend that much on the stories that you're taking on the virtual machine right rather than storing the in frequently accessed data. Why not put more frequently exist. So what you can do is the in frequently accessed data that you have in your machine on the cloud. You can actually take a backup of that and store it in the backup service. Now, why will you store it in the back of services? Because storage is more cheaper when you talk about the backup servers because obviously first of all, they'll use magnetic tapes or they'll use ssds or something like that to store your data now, why is it cheap is because obviously it has a downside that the response time of the time to retrieve the files from a backup service is obviously more. For example, if you are stored everything in your virtual machine, you can like go to that particular folder access that file and that is it right. But if you have stored in the backup service, the retrieval actually takes time, but it is worth it because you don't use that file every day, right? You won't be using it and also you're paying less so it doesn't pinch you that much because you're paying less and you are not using that file very Yes, well, so why not put it in the backup service? So this is what the backup service is all about. Now today in our implementation. We are using the blob storage for obvious reasons that we I want to store my image files, right? So I not store it on the back up obviously and not show it in the queue storage As Told in the blobstore it because that is what that service is meant to do. Now. The next service from Azure is the MySQL service from Azure. It is basically a MySQL implementation on the LG. Our infrastructure was right, so you Can use any database you want another you have an SQL service, which is purely SQL. So if you're comfortable with that, you can use it. I am using MySQL for my use case today because that is the way I have quoted my application to be right. So it is just personal choice. The next service that we are going to talk about is auto-scaling and load balancing. So like I said load balancing is when you want to equally distribute your Among the number of servers that are running that time and auto-scaling is actually scaling up the number of servers that you're using according to the traffic that is coming onto your website. So you can actually set a metric that so many obviously when more traffic is coming onto your website your CPU utilization will increase because you have to process more requests now. Yeah, so your server will be processing more requests and that is the reason your CPU usage will He's so you can actually set a metric. Let's say my CPU usage when it increases 60 or 70% increase one more instance or increase three or four more inches high. So it is based on your personal use. So this is what order scaling is all about. And obviously when you using Auto scaling, the number of servers is changing constantly, you need a load balancer along with it, right the load balancer so that say you have six or seven servers which are running right now and say the traffic decreases and it sees okay now the sea Utilization is going down. So it will reduce the number of servers. Right? So when it will reduce the number of sources do load balancers should identify. Okay, though. They were seven servers before now there are like three so you'll be Distributing the traffic according to those three servers, right? So the load balancer actually pays a very important role in the order scaling process having said that so this is how all this killing actually works. So say you have one server, right and the usage increases it goes on to become two servers and then again the usage increases it becomes 3 service right now when the users decreases these three servers can be reduced to one server or can be reduced to so so this is a diagram representation of what or scaling is. We talk about load balancer. Like I said, so load balancer is a very crucial part of Aura scaling process because load balancer is the part which actually distributes the traffic according to the number of servers that are running at that time. All right. So this is how the process Smokes the traffic comes on to the load balancer and the load balancer sees how many servers are running and distributes traffic according to that. All right. Okay. So we're done with the services. These are the services that we'll be using today. So now we will see how we can launch these services in the has ER user environment. So guys will talk about the Apsos first. We'll see how we can launch an app service in the as your UI. Okay, let me show you the user interface for a year now. So guys this is how the user interface for as your looks like. You have all the services listed here on the left side. Right? And this is the dashboard. This is called the dashboard whatever Services you launch. You can pin it here for basically getting accessed quickly. It is just like a desktop on your computer which has all the shortcuts in everything and this is what the dashboard is actually used for. All right. Having said that let's see how we can launch the app. So In Azure, so first you will click on app Services as you can see from here. You can click on app services and moving ahead. Once you have clicked on app Services. You will reach this plate click on create app services and then you'll click on web app and that is it. Let me show you how you do that. So you'll click on app Services click on create app Services you go down click on web app. And over here as you can see after this, you will reach the screen when you will see that you have four options. You can either code your website in.net PHP node.js or python. So if it is either of these four languages, you don't have to do anything. You just have to upload your code in this web app that you'll be creating and your app will be deployed automatically without installing any software without doing any configuration Justice, right? Okay. So once you have reached this page You will click on create. So let's click on Create and then you will reach the screen. So now you have to give your application some name. So let us give us this name as in Eureka - 0 1 so see that everything is fine. So this subscription is pay-as-you-go Resource Group is something which you can create or you can use existing. So Resource Group is something it's a group of all the resources, right? So if you put if you are it will be creating a storage. Count will be creating database account. We are creating an app. So it's right. So all of this will come under one group. It can be clubbed in one group and will be called as resource for any changes that you want put across the group you can do to the resource Group. All right, we'll be discussing in detail. What a resource Group is in the further modules, but for now all you should understand is that a group of resources is called a resource book. So if you have an application and just utilizing say three or four resources, it's better to put those resources. Under one group. All right. So this is about that. Then you have the app service plan. So app service plan is something as in what kind of computers you use and everything. So let's create a new plan for you so that you understand it better under the pricing tier. This is the main part that you have to select guys. You can select the app service plan it can give it some name. Let's give it as a service - 1. All right, and this is my app service plan. You can select what kind of plan you need. Let me see. Like the basic plan as of now and click on select right and then click on OK. So this was about Apsos plan. You can click on application insights which basically gives you the monitoring tools for now. Let's not discuss it. Let's not go into it. We'd be discussing it later. And now let's click on create. So I am taking the PIN to dashboard which will basically create a shortcut on a dashboard to this application comes in handy. And that's it guys. You will click on create. Alright, so now my application is being created. Okay, so all right why my web app is deploying. Let me go back to my slide and let's jump onto our next service which is blob storage. So like I said blob storage just like a file system. You need a file system to show your files, right? So that is what the blobster is all about. Let's see how we can create a blob storage instance in Azure. So you will reach this is the dashboard you reach the screen. You will click on storage accounts. Once you have clicked on Story the council click on ADD. And that is it guys. Nothing much acquired. Let's go ahead and do this I go here. I'll click on storage accounts. I will reach the screen and click on ADD and I will start entering the values. So let's give it the name called Eureka - 0 1 so this is taken. Let's give it a name as well as your I do. Write this name is available. All right, the performance should be standard because this is a demo replication is not required. So I'll say locally redundant Storage storage service encryption should not require secure transfer is not required and subscription is pay-as-you-go. Okay Resource Group. Let's select a director - 0 1 because this is the resource Group that I selected earlier, right and let's pin it to dashboard. click on create Alright, so my web app has been deployed already and my storage account is also being deployed. All right, so this was about it. Let's go on. Let's see for our MySQL. So for MySQL, let's see what all we have to do. So we will click on you. We will click on databases and then we'll click on as your database for MySQL. All right, and that is about it. Let's go back and do that. So we'll click on new. The search for as your database. for MySQL All right here this so I click on this and I'll click on create. So here it is. I have to enter the server name. Let's enter the server name as Eureka - 0 1 it is available. It's good. The resource Group should be the same. So let's select a riruka - 0 1 so admin login name. Let's give it as any Rekha password. Let's give it any Rekha one, two, three, four confirm the password and Eureka one, two, three four, and it is asking me some special characters or let me add the special character as well. Okay. So basically you cannot have the login name and your password. So let me change the password to add you one two, three, four exclamation same in the confirmation. All right. So this is available. Now the location sounds introduced version is 5.7 pricing tier. Let me see if there is something more or less. All right. I think this I click on OK. Bennett dashboard and click on play. It's pretty simple guys. You would know when you will do the Hands-On on yourself. So the pricing tier can be the minimum if you are using it for demo or if you're creating an application, which is for global scale application huge can choose the pricing Theory according to that. Alright while it is deploying. Let's move ahead. So let's come onto the auto-scaling part now. So basically we have to configure our web app to order scale as and when required It so let's see how we can do that. So let's understand the types of Auto scaling first. So basically there are two types of scaling one is called horizontal scaling and one is called vertical scaling. So horizontal scaling is when you are increasing the number of servers that you require say, you don't have an i7 server. For example. All right. Now the usage goes up so you take to i7 servers and if it again goes up you take 3i7 SOS, right. So this is what horizontal scaling is all about right? Let's come onto vertical scaling now. So vertical scaling is when you are increasing the capacity or the configuration of your system say you were using an I3 system before right the traffic increases. So now you're using an I-5 system the traffic increasing now you're using the i7 system. So you are having only one machine but you're increasing the configuration of your system, right? So these are the two Types of scaling which exists in auto-scaling also the other way is manual scaling so you can also manually scale up your in the number of instances or the configuration of your system. Right? So the way to do that is to manually go into the service change the pricing tier and you are said this is how you manually scale auto-scaling. I'm going to tell you in a couple of you slides. Also guys when you are auto-scaling like I said load balancing is Quickly attached to it. Alright, so when you would be orders killing in a web app, you don't have to configure the load balancer. The load balancer is configured automatically and said automatically for you to be used right because it doesn't make sense to use or scaling and not use load balancer. And that is the reason as your has automated the process of attaching a load balancer when you using orders Right Moving ahead guys. Let's see how we can launch this instance. So guys first you will click on app Services. You will go to your particular. Instance that ER have launched you will go to scale out and you will click on enable auto scale. All right. So let's do that. We will go to app Services which is here. So this is my instance. I have launched I click on idea raiga - 0 1 I'll go down. And as you can see I have two options. I have scale up and I have scale out when I click on scale up. You see the pricing tier so I can increase the configuration of my system right? But this is not about what I want. I want to scale out which is I want to increase the number of instances running right now, right? So so it says Auto scale is not supported for basic chair of web apps. Okay, so let me change my configuration. Alright, so if I go to scale out now, you can see that I have the option to enable auto scale. So I will click on enable auto scale and then let's give it a name. Let's give it a name as any Rekha Auto. Alright, so my auto scaling property name is Erica Otto. The resource Group is a Eureka - 0 1 right. So now you have an option to Scale based on a metric which is based on some statistics. Like the CPUs is or the memory usage or anything. Right? And the other one is scaled to a specific instance count. So for example, whenever the traffic increases say you were one instance now like increased five instances. All right. So these are the two options will go with Scale based on a metric and scale out in scale in your instances based on Metric. All right. So let's add a rule. Let's add the rule as in what we want. What kind of metric do we want to? Monitor and scale according to right? So as you can see the time aggregation is not something we should be worried about. Okay guys, so these are all the metrics that you can actually monitor and scale according to you can scale according to the memory percentage. You can scale according to disc, uh dpq data in and out, right? So let's for now keep it simple and scale according to CP percentage right time. I'm is not something you should be worried about and the operator. All right, so what should be the condition so should it be greater than or should it be greater than or equal to let's keep it at greater than or equal to. So whenever the threshold is greater than a whenever the CPU Z will go greater than or equal to 70 for 10 minutes so you can set this as say two minutes, right? Okay. Let's see. It says that it should be between 5 and 7 2000. Get let's keep it at five increase count by. So let's see what our options we have here. So you can increase by percentage. You can increase by count to as in if you were one. You can increase it to 10, right and you can decrease the count or you can decrease the person by as well. Alright, so when you are auto-scaling guys, you have to set two rules one is the rule to increase R. Obviously one rule is there to decrease so whenever the traffic goes down you have to decrease Reese your instances as well. So for now we are setting the increase rule so let's set the increase count by option. So how many instances should increase I think one is a fair number and cooldown is something that is actually there when you are say you are asked you right now, right and then say you order scaled one minute back. And again the CPU usage goes up. So rather than going on and Filling up again. What you can do is you can wait for 5 minutes and watch the metrics right because it doesn't happen in a second that your CPU usage will go down because there are a lot of services which are actually running right so you can beat once your new server has been deployed. You can wait for the traffic to be transferred to that server as well. And then you can see the metrics go down right for that. We keep something called cool down minutes, right? So we have the default is for Five, let's keep it at five only and now this is it guys. There's nothing else to configure. Let's click on ADD. Alright, so as you can see, this rule has been said, let's add one more rule to decrease. So the CPU percentage is fine. The operator should be less than or less than right. So whenever the threshold is less than 50% Decrees count by one instance and let the cool down be this much. Alright. So again, the cooldown logic goes here as well. Say you decrease an instance. And again your CPU is still low because it takes time for your traffic could to get transferred to the server number. It has the keys down to right. So let's keep the cooldown in it. So we'll click on our now. All right, so we have added the auto scaling group. Hello guys. This is a there's nothing much to consider. Actually, if you think about it, it's a very complex process. But as your has given you the Simplicity to do it very simplistic or a very English manor because you just say like I said if the CPU is above 70% increase the number of servers by one, right? So if you go here and if you don't know about auto-scaling you can actually figure out what is happening, right and same is the case with scaling. So whenever your CPU is less than 50% Decrease the count by one, right? So as you can see you can actually read it here that this is what we have configured. All right, so let's save this now. Alright guys. So this is how you order scale your web app instance now, since we are doing a demo guys, we don't require the order scale module for my application. So I'll just discard it for now because I can't even demonstrate this to you. Right? So I just showed you how you can order scale. Now. Let's go back and see what all is left. Alright, so now we are going to do the demonstration. So we have launched each and every service we have launched the Absolute we have launched a blob storage and we have launched a MySQL for yard right now. Let's go back and check and deploy our website. So let me show you how the website looks like in my local host. So my Local Host is this alright? Okay. So this is showing me an error because as of now, my code is not connected to my has your instances. All right. So let's first configure our instances. So let us go to the dashboard and let's first configure a database. All right now for configuring your database. The first thing that you have to do is connect to it right. Now the way you can connect to it is using the command prompt for that. You have to click on connection security. Now you cannot connect to your database just like that. You have to configure your IP address in the set of rules that are there for the fireball of the database and when your IP address is listed there then you can connect to the database. Let me show you how let me show you that you cannot connect as of now. So I will launch the command prompt. I will go to my MySQL installation. All right. All right. So this is my my actual inflation guys. So I will type in the command MySQL - etched pace and then the server name which is this I patient here. All right, then I will give the port number. So the port number is - capital P guys. Don't forget its capital P. It's different than small P right small piece of password capital P is for the port number and then I give the user name. So the username is this. Patient here, right and then I will type in the password and hit enter enter the password, which is Nu 1 2 3 4 exclamation and enter see as you can see client with IP address is not allowed to access server. All right. So now what I'll do is I'll go to connection security. I will add my IP and I will click on Save. So say successfully updated connection security. Let's go back to our Command Prompt execute the same command again type in our password. And now as you can see, I have successfully connected to my database now, I can create a database here called anyway car. Let me create a database. Let me clear the screen. Okay, so I forgot I'm working on windows. So in Windows you cannot clear your my screen. What a sham. All right. So if you are using Linux you could have just typed in control L and it would have been fine. All right guys, so as I was saying, let's create a database called Eureka so create database and Eureka. And that is it. Well type in use at Eureka. I'll create a table. Let's create a table called image, right and title name is just one second. My call name is name. All right, so I've created a table. So if I type in show tables it will show me the table name, which is image. All right guys, so this is done now I have created. The table at first I created the database quality Rekha and my - here which is hosted on a job and then I created a table called image in it and the table has one column called name, right? So this is it. This is my MySQL. So my MySQL has been configured now. Alright, so my MySQL has been configured now. Let me go back to the overview. Alright, so my MySQL has been configured as you can see in the databases. It will show that there is a database called at Eureka which had just created. All right, let's go back. You might have to add the web apps IP addresses. Well, we'll do that later. Let's go to our Philip now awesome, so we'll go to our web app. And guys, this is a web app. This is the URL for your website will click on this URL and you will see a welcome page. This is your welcome page. So now what you have to do is you have to upload your code over here. Alright, so the way you can do this is using GitHub, or you can do it using FTP as well. Now I know most of you are from non-technical background, so you might not be knowing what GitHub is so for now. What I'll be doing is I will be using FTP software called filezilla for transferring my files from the next session onwards. I'll be using GitHub and for that I have actually there is a video in your LMS, which is a short tutorial on get up how to use get up which is enough for a demonstration. So you can go through that video before coming to the next session and then we will be using get out. All right for now. Let's just Use the FTP software which is called filezilla. All right. So the way you can connect here is like this so you have to create a deployment credential. Alright, so my deployment credentials is HR 1. Let's give it a password and the password could be. Okay. Let me give as hemanth one nine nine. All right and over here also a mint one nine nine. All right. Let's click on save. Oh, maybe this usually means not available. So let me give it a charger 1 2 so you can save okay, let's try this again. It sure went to all right, maybe I'm connected here. Maybe that's why it makes it it it's him and one nine nine four. Hmm. It's click on Save. All right, so I get out of here, right so later we have successfully reset the deployment credentials now, alright, so what we can do is I will go back to my lab. All right, so now I can get connected to my web app. I have to win to the FTP host name. So it will go here one second. All right, the hostname will go here. The username is hr1 to password is this right? And what else? All right, the username is just some sorry. The username will be this. All right, let's click. click on Quick Connect All right. So as you can see, we have successfully logged into a FTP channel so over here you will go on site right? We'll go on www.hsn.com copy all your website files over here. So let us do that. My files are some here. All right, so let's copy the files now. I've came just drag and drop it over here and the process will start now it might take a while. So let us configure some other file by my website is being copied. Okay. So now what we can do is we will go to our dashboard and we can configure storage. Mind you guys I might have to upload my code which in my web app because there are some things that I have to change in the code because the addresses and now I'm creating new Services, right? So I'll have to change services address in the court. So I'll do that and then I will update the particular file that I will be changing in in my web app. So let me just give me a minute. Okay. So now what I'll do is I will create a blog over. It I create a container and the container name shall be hello and the excess type P container. All right, I click on OK so I have successfully created a container called blob. If you go in properties, you will see that this is the URL for it, right? So let me show you the code for my website guys. So this is the code for my website. All right now I'll have to change the url at places. So let me do that. So it will get changed here. All right, then my container name is hello. So that is okay. And now one more thing I so whenever you are basically going to connect to your storage account the order your blob storage. You have to go here. I'll show you will have to go to Access keys. So here's a key right so you this is the connection string that you have to include in your code. I have copied it. I'll go here and I will include it in the connection string code. All right, so I control V and over here. You have to remove the endpoint suffix. All right. So this is not required. If you put this it will not work. Okay. I don't think anything else is required. Yes, I have to change the database credentials as well. So let's do that as well. So we are storag account is set or you don't have to change anything else. Let's go to the MySQL. But all right, here it is. So the server name has to be changed. Let's copy the server name. And give it here. So the host name is this. Alright, and let's see. So I login name is this let's put the login name here. Boss word is any one two, three, four exclamation, which is right. Dima name database name is Eddie Rekha, which is night username user table as image, which is right and the field name is name. Alright, everything seems fine one more place. I have to change it. So let's do that as well. So let's copy this paste it here. Copy our username. Paste it here. And everything seems fine now. So now when I try to run the code, it will run on my local host, but it will not run on my web app. Why because I'll tell you so I was getting these warnings right? So let me refresh wait. Let me save it. So let me refresh it now. Okay, one second. Okay, CeCe successfully updated. Let's go back and check whether it's working. Alright, so basically you have to disable the Infosys cell Connection in your MySQL and that would be it if I were to do this, alright, so now I will choosing a file and I'll be uploading this particular file, which is Desert. I'll click on upload image and it will take some time to upload the image. And it says well done blob update complete and as you can see my image is loading. Let's check whether we have it in our dashboard as in our storage account will go to 0 and you will click on blobs will go to Hello container and you can refresh it. And as you can see, there will be a file here, which says 1 4 9 6 7 4 2 4 6 8. All right, so let me connect to my MySQL now again, all right. Just give me a second. I will type in my show - Edge and then the username So this is my host name guys. So I'll copy The Source name paste it here and then my port number which is 3 3 0 6 my username, which is this I pasted here and then password which is as of now this Eddie one, two, three, four exclamation. Thank you termination base. I use the ddps that I've created select table and I will show you the record now. Let's compare it with what is there? It's wonderful 9 6 & 4 2 4 6 8 and it's 1 4 9 6 7 4 2 4 6 8. So guys as you can see the same file has been uploaded here and it has been mentioned here. So what my website is now doing is it is basically Fetching the file from my database and then accessing the file over here in my file system and hence displaying it in its background. So as of now additions, there is only one image. It is not showing the slideshow. Let me choose one more file. Let's upload the koala image and click on upload image. So now when you will see that the image which is being loaded and if I go here and I refresh it. I can see that there are two images now here right and in my database as well if I refresh it I can see two images. Alright guys. So this website seems to work fine. It is connecting with my storage account. It is connecting with my database on a job. Now. Let's check if my files have been uploaded. So it says okay this might take some time guys. So let's wait because we are all set here. We are done with everything. We are just waiting for our files to be transferred here and then I'll show you how it works over there. All right, so let's wait Alright guys, so my transfers have finished. So now let's check whether my web app is working or not. Right? So I'll go to the dashboard. Are you go to my web app? And this is the link I'll click on this link now guys. Like I said, you have to add the IP address of the web app in the MySQL as well. So when I go here you see an arrow, right? And now like I said, we have to send the index file again, so I delete the index file from the server from here. All right, copy the index file again because it's been updated. All right, and now I will refresh this. So as you can see it says the IP address is not allowed to access the server. So what we'll do is we will copy the IP address. We will go to our database were connection security. Alright, so here we are will select the web app give this therapy and the ni P. All right. So let's get rid of the spaces. And this is it now we click on Save. Now, why are we doing this? We are doing this because here we got an error that this IP address is not validated with the MySQL. So we have added this IP address or where it says successfully updated security settings. Let's refresh it and check. Okay, awesome guys. So now my website is working. So I have successfully updated my website in the web app. All right, and I didn't have to configure anything. I didn't go to the UI. I just transferred my files and my website is up and ready. This is the address which is being used to get to the website. All right, so guys this was the demo. Let me get back to my slides. So let me recap what I did. I configured my app service with the code. I configure no MySQL with the IP addresses of my own computer to configure it and the IP address of my app service so that the app servers can communicate with mySQL. I configured my blob storage and I configured it address in my code my PHP code and a configured the host name and the password for the created MySQL service in my PHP code as well. So guys this Is what we did. All right having said that let's go ahead guys. So we're done with the demo. Let's get on with us your pricing now. Now whatever services that we have used. What if I tell you that you can use them for free? Yeah. So let me teach you guys how you can do that in the as your pricing section. So as your pricing sections has these three features. All right. So what the first time you register on Microsoft Azure as a new account you first of all get $200 worth of free credits in an account. Now what you can do with this $200 you can use it to deploy application as in many want. So this is a one-time free credits that are allotted to you on registration. Also with these credits. You can explore any services for free India 0 for the first 30 days so energy or you can use these credits to be to launch any kind of service for the first 30 days and Of course after you use the services, you don't have to pay anything, right but you might have to register your credit card with them because that is how it works. They'll charge you one rupee in that and then they will refund the one rupee afterwards. This is just for verification purposes. Because once your free trial ends, you have to upgrade your plan to pay as you go or whatever that you are looking for. Right but the good thing about a jar is that sometimes it happens that we start using the free? Thing and we forget to see that it is only valid for 30 days and we forget that and after 30 days if you use another Services you get charged, right, but with a zero that is not the case with a 0 what happens is you are given a pricing tab. It says free trial, right? So at the end of 30 days, it says free trial expired and you're not allowed to do or you're not allowed to access any of your services. It is only when you manually change your plan from free trial to pay as you go. That when you can actually start using your services again, so which is a good thing by a job because you have control of your finances in your hand, right? You will know what you get charged for and that is something very transparent about as you're with that it has come up in this is a very good thing having said that lets go ahead and understand the two plans which are there one plan is called pay as you go plan and the other plan is called six months or 12 months and so basically with pay as you go plan. The thing is that you take a service or you take an instance and you use it for one day or two days or a week or two weeks and you pay for that amount only. All right, but when you want a longer commitment say for example our website right a company's website. It's called any record orko. So it will be there until the company is there right? So for those kind of cases, it is better to go for long-term plans because with long-term plans you get discounts, right? So if you compare it with pay-as-you-go if you are using Instance of it be as you go plan for six months and you compare it with the service or instance in which you have opted for a six-month plan or a 12-month plan and you have gone through the six months the amount of money that you're paying in that and the amount of money that you're paying through the pay as you go service is obviously less, right? So the other thing is with the plan the catch here is that you have to pay a full up front or partial upfront payment for the six months or 12 months or whatever term that you want the instance to be running on. All right. Right. So this is the thing that you have to kind of things you have pay-as-you-go plan and then you have a plan Baron you pay in future. So it's basically like prepaid and postpaid with Prepaid. You have six months in 12 months plan with postpaid. You have pay-as-you-go model having said that let's move ahead guys. So this is the thing that you guys have been waiting for the free things that you get in as all right? So the services that we use today the app service for example is free, right, so it is free up. An extent that you can host up to 10 web and mobile apps on any platform or device in a jar for free, right? So for more information, you can go to this link which I have added in my slide. So this link will take you there and it lists all the services which are some of the services that we have not discussed today are also included under the free subscription. Another good thing with Azure is the guys that even if your free trial ends these three things will be there for you, right you can use these three things even if the field trial ends these three things are there for life. So the first 10 app services that you use in his yard, they are free similarly with the case of virtual networks. You can actually create 50 free virtual networks with Jean right after the 50 virtual Network that you have would have created the 51st would be charged for you as one virtual Network. It is again a cool thing, right? So Gob servers and watching it, but like I said, there are other services as well. One, two, three, four, five six six in all which are free. When has your for a lifetime. So there are some restrictions like for example in app service you have you can only run 10 app services for free similarly. You have these Services as well. Alright, so this is a cool thing about Asia that even of the field trial ends. They give you free services having said that guy's okay, so that brings us to the end of our session. So today in this session will be understanding Microsoft Azure storage components. All right, so let's go ahead and see what is our agenda for today. So we'll start off by discussing. Why do we actually need storage? All right, and then we'll move on to the question which is frequently asked that when do we use storage versus when do we use database right after that? We'll move on to see the topic of the day. Which is what is as your storage and then we'll move on to discuss the components of azure storage and towards the end. We'll be doing a Hands-On on each and every service that will be learning today. All right, so guys, I hope the agenda is clear to you. I welcome you all to the live session any doubts that you have please put in the comments section. I am a team with me here. They'll be answering all your queries here today. All right. So with that let's begin today's session with our first topic that why do we actually need? Storage. All right. So for this let's take an example first. Let's take a use case and see and understand. What is the need of storage in today's era. All right. So for example, we have an image processing application, right? So for this image processing application, we have given the user interface as a website so round say a million people can access my website and put in their request to process their image. All right, so we don't want the processing of the image. To happen on the server, which is who she met my website. I wanted to be happening on some other server, right? I want the processing to happen on a back-end server. So for that we have some back-end servers now my request for the processing will come in from website project plan template excel servers. So I need a place where in I'll be process will be storing all the jobs. Right which can be accessed by the backend server as well. So for that I need an entity where I wherein I can dump in all the jobs which are there. R which had to be done by the backend servers now, obviously all the jobs cannot be done simultaneously by the backend servers, right? So say, like I said, there are like million people who are accessing your website at once and they put in a million requests, right and your back-end servers cannot process all the requests at once so they will do it one by one right and they can do that with the help of this entity. They will put their will pick up a job do that job and then go again back to the entity picked up. Other job go back to the entity and so on. All right. So now when you have all the jobs in this entity, these jobs have to be distributed equally to the backend servers right? Once that is done. Once your back-end servers process all the images which are there or process an image which has which had some operations to be done on it. Then the image has to be stored somewhere, right because you have to store the end result somewhere so you Store all the properties like the name the location of the image everything on the database But Here Comes the change. You cannot store an image on a database. I mean you can actually do that. But when you look at the data that an image contained it is all randomized it is there is no structure in the data that an image has or for that matter any video file as or any any kind of file has right? So that is the reason we need an entity to actually store this kind of data so that the The thing that is required to query this kind of data, which would have been there in the case when you would have stored your image in the database, right? So in that case process a lot of processing is required if you try to query them, so we wanted the processing power to become less the processing burden to become less. And hence. We hence we wanted an entity we can do which can actually store any kind of file Let It Be images Let It Be video files Etc came in storage. So let's discuss the first case where in we had to Oh the jobs, right? So when storage came in now, we can actually put in say ten thousand jobs per second inside the storage the storage service without any overburden on any of the servers breed back-end servers or beat website servers, right? So the processing time has drastically reduced and the jobs are now listed in the Q. So Q is actually a service which is offered by storage. Right? So now what back-end servers will do is Take up the job from there and execute it. And once they've executed that job will be deleted and the next job will be queued next when we talk about this section. We're in we had to store images. So now any kind of file can be stored on these storage service, which is offered by Cloud. It's not only limited to the cloud if you think about it in your computer in your own local computer on your mobile you store some pictures or you store some video file. Is right and you store it inside a file system. It is not a database. It is a file system and it can contain all the objects that you want to store. You. Don't you do not store your objects inside a database. All right. So this is why storage is needed. Let's go ahead and and understand what is the difference between storage and a database? So a storage is basically needed whenever you have objects. Like I said, so you have any other music files when you whenever you have video files whenever you have Images that show in all these kind of cases you use a storage kind of service but when you have say something related to the metadata of a file, for example, when you store the file in the storage you need to have the location of that particular file, you need to have the properties of that particular file. So all these things all the properties all the any location column that you want to add all these are structured right? They're not Randomized and hence, they can be added inside a delivers bead SQL and nosql it can be added. Right? So this is the main difference. This is how you will differentiate between using a storage and a database moving along guys. So now we have understood what our databases water storage Services. When do we use the Surah service? When do we use the database service? Let's move on to the topic of the day, which is a 0 story. So what is azure storage? So Azure storage as a service from a server. So you use it whenever you want to store something on the cloud and since we are using the cloud provider as as your will be using the storage service from Azure and that storage service is called the Azure storage. So it's now when you begin to use the Azure storage service. First of all, you should have a storage account which you can create in the Azure management portal. So let me show you how you can do that. So let me quickly jump onto my browser so that I can show you my has your bored So guys this is how my dashboard actually looks like right? So as you can see on my dashboard, I have all the services listed. So what I'm interested in today is the storage account. So I'll click on storage accounts. So I have some deployed already over here. I click on add to add a new storage account. And then I'll have this page now. You will enter the name of the storage account here. So that name has to be unique. So let me enter a name say live demo 2 3 2 W 3 6. All right, so that seems to be available. Then comes the option of account kind right? So how do you want that account to be what would it be a block storage or would it be a general purpose so we don't want to restrict our account to only blob storage. We want a general-purpose account. Right, so we'll choose that and then comes the replication part. How do you want your data to be replicated now, there are quite a few in what should I say? There are quite a few good options that we have here one is called the locally redundant storage. So when we have the locally redundant storage what this basically means is so understand it like this that there are regions and inside a region there are zones. So for example, we have the US and inside us we have cities like Chicago New York right now. It's in New York and Chicago are two zones and the region is us. All right, so when I say locally redundant storage what that basically means is that inside a zone that is inside in say New York. You have a data center for Azure in in that data center you are so your storage account has been created. So when you select the options or option of locally redundant storage, what basically does is Italy it will replicate your data inside the data. Arrows it is replicate the data inside the data center in which you have actually deployed your storage account so that if one server crashes you you have your storage account in other server and that same particular premise, right? But when we choose Zone redundant storage what that basically means is so a Zone was Chicago or New York, right? So in Chicago if you have a data center in in New York if you have a data center, so whatever is there in the New York data center will be replicated to the Chicago data center as well so that if One's own goes down. So if this if the data center in New York goes down Chicago would be up and hence your storage account can still be used. Alright, so that is what the meaning of Zone redundant storage has when we talk about Geo redundant storage. What we basically mean is you have different reasons. So for example, we have the u.s. Region and we have the India region. So inside so inside India region, we have different zones, right? So if it's select the Geo redundant option, we will have the read write access. To both these regions that is in the u.s. Region and the India region as well. So whatever you have deployed in the u.s. Region in the Chicago Zone will be replicated across India region as well. Whatever zones you ever deployed in India regions also, alright, so this is what the meaning what is the meaning of g or in in storage? And then we have the read access Geo redundant storage, which is a very interesting option where in you only get the read access of the redundancy for example your means It is in New York, right? So it's a Zone inside the u.s. Region. So if you select read axis gyro redundant storage if in India, your data will be replicated to India as well. But when a failover happens that is when your New York server is down and when you are accessing when you are redirected to the India region in that case, you can only read the data. You cannot write on it. All right, so it is useful for those applications, which only I fetch data and there is nothing to write. So in that case G or in and storage would actually be pretty costly for you. But if you select the read axis during another storage, it is a little less cheaper than the Regio redundant option since you're not writing on it. You don't want your data to be replicated whenever you write a thing, right? And so this is the reason that read axis gyro redundant storage is kind of cheap, but since ours is the demo today, so I'll select a Leader done storage and then the subscription you can choose a pay-as-you-go or free tier in your option. If you have created a new as your account and then comes the resource Group. So Resource Group is nothing but a group of resources. So it is basically created to manage your resources more efficiently in the case. When you have a large use case wherein you're deploying a host of different Services if you include them inside one group, it becomes easier to manage because if you want to delete all the Resources you just have to delete the group and all the resources and the dependencies will be deleted automatically, right? So this is how the resource Group is helpful. So we'll create a new Resource Group today Let It Be Live - demo 1 right and we'll pin it to dashboard and we'll click on create. So when we pin it a dashboard it basically has a shortcut on the desktop for as your so let me so while this is being created. Let me show you. That dashboard actually looks like so that dashboard basically gives you all the shortcuts that you want. So this is the dashboard guys. So you get all the shortcuts that you want to your services, right? So my life so my storage account is now being created is called live demo to double 3 6 so I can quickly access it from here rather than to go to my store particular service account over here and then accessing it. All right. So while this is being created guys, this was about as your storage this is how you create. Date a storage account. Let me come back to my slide. So this is what an Azure storage is let's move on to discuss the components of azure storage. So right till now we have discussed how you can create a storage account. But inside the storage account you have a host of different Services, which you can make use according to your use case, right? So the first service is called The Blob service. So what a blob service so blob service is nothing but a file system service where in you can upload any kind? Failed, right? So the for those of you who know about AWS so AWS has a service called S3, right? So it is exactly like S3, right there is nothing change into it. Just the name of the service is called blob now inside blob you can upload any kind of file and then that file can be accessed by depending on the permissions that you are going to can be accessed by anyone on the planet. For example, you have created a website and it's showing some images. So those images rather being on. The websites server. It could be there on blog and can be accessed directly through the link of any object that you actually upload in the blog. All right, having said that guys let me quickly show you how you can create a blob storage. So let me go back to my dashboard. So as you can see my storage account has now been created. So if I go into my storage account, I get the screen wherein I have to choose a service. All right, so Let me click on blogs because that is what I want to create I click on blobs. I'll open open it in a okay. I'll open it in the same Tab and then it will show me a screen where it will show me that there has nothing been added. Right so there are no containers yet. So what are containers containers are nothing but folders that you have inside the blog? All right, so you cannot store anything in the root directory that is you cannot store upload any file over here. You have to have a folder inside which you will be uploading your files. All right, so folders are nothing but Dino's don't get confused with the nomenclature. Right? So inside this I will create a container called life - demo. Right, so it's done the access type is blob. So what that basically means is if its private it cannot be accessed by anyone if it's blob inside this particular container, all the files can be accessed and if if it's container this basically means that if it inside this container, you have created one more folder that also can be accessed. But when we select blob only the files can be accessed. So we'll select blob and will click on OK and it will hardly take a second to He ate a container in the blob service. Alright, so we have a container now, which is the live demo and if you go inside this container there is nothing in it as of now, right? So now I have actually created a website which can interact with The Blob service. So let me show you how that website actually looks like or before that let me show you the queue service I discover the queue service first and then we'll come back and discuss the blob right? So let me come back to my slide so blobs. Like I said, you have created a Blog you can upload. Any kind of file inside a blob using a website or you can read the files as well from a website. All right, let's move on and discuss cues. So what a cues cues are basically it's exactly like a data structure wherein you whatever information goes first is the first to come out as well. Right? So you use a cues to basically lists job. So in our use case we discuss that we have an image image processing application which has millions of Was as accessing it and since millions of jobs cannot be executed at once they are listed inside the queue so that the server at its own pace can fetch the jobs and executed right? So this is what a queue is all about as simple as that now the way you can create cues in the has your dashboard is something like this that you have your storage account, right? So let me go to my storage account. So my storage account is now being opening. Alright, so inside my storage account with The Blob services Well, I had cues option right so I'll go to that choose option and create a new cue. So my my my storage account was live demo to double three six, right and now I will choose cues. I'll go inside Qs. And as you can see as of now, there are no queues that have been created so I will create a new cue and let me call it. Hello one two, three. All right, so I'll create the to now. So my Q has now been created now if I go to my website, which is therefore Q, this is how my website will look like if I want to upload some data into Q. So this is a sample website guys that I have created. Now. This website has to have the has to know how to interact with your queue service for that. You have a thing called your connection string. So every storage account that you create will have a unique Second string that you have to include in your code. Now if I click on access Keys here, you will go to your storage account and then you'll have this pain in that you have to go to access Keys. Once you go to access Keys, you will have a connection string and a key so you have to have the connection string in your code included so that your code can interact with the particular service. All right, so I'll go to my cues code so my Q code is this and if you can see this is the connection string that I have to specify. I will copy paste this connection string over here. And this endpoint has to be removed because it is not required in the connection string. Once you do that you will save it McHugh name is hello one two three, so it has been already specified here right now. I'll go back. I will go to my website, which is this right? So I've already specified to it for it to send messages to my queue, right? So if I send a message saying hello. old right and I click on send a message. It will actually send that message to my queue which can be seen here. So as if you if I go to my queue you can see that a message has been added with says hello world. Alright, so this is what I just entered now if I go on and process this Q, which is I want to receive message now, so I'll have to change this in the PHP as well. So I'll go to my process PHP. For my cue, I'll change my connection string so that it can interact with the queue and fetch the messages from over there. Right? I'll change it here. I'll change the endpoint as well. And now my code will be able to interact with my cue that I've just created. All right. So if I go to processed or PHP it'll basically fetch the message from that q and display it here. All right. So as you can see the message received is hello world if I enter any other message say as Eureka. Is the best right? I entered this message. I send it to the queue. All right, and now when I process it, I'll get the same message back. And if you will see over here guys, I'll just refresh it. Now as you can see the message has been processed and it has been deleted from the queue. So as and when the message is processed, it is automatically deleted from the queue. All right. So this is how my cues work. Let me quickly show you how the blog's work, right? So let me go to my blobs website. So this is where I'll be uploading a file onto blobs. And again, I have to change the connection string again, right? So I'll go to my blog code and change the connection string which was here. Alright, I'll change the connection string to my current storage account. And my container name I have already specified it to be live demo, right? I created a live demo container now if I'll save this code and if now I choose a file and say I upload the desert file. All right. So what it does is it basically renames the the the name of that file automatically according to system time so that there is no Clash when two or three files are updated with the same name. All right, so I'll upload this file now so as Now as you can see if we go into our blog there are no files. Right if I go inside my blob, which is here. There's no file in it. Right but the moment I upload the file from this particular website. My file will be listed here. So as you can see, my file has been successfully added over here. And now if I go to the particular link of this file, I will be able to download the file. Right so my down my file is now being downloaded and once it is downloaded and if I try to open it will be the same file that I just uploaded. Right. So if I open it now you can see this is the file that we uploaded in the blob and it is now accessible on this particular link by everyone in the world. Alright, so this is how cool blob is now. I'll be using blob and q's together. Let me show you how so what I basically do now is this this image or this image that I've just uploaded has also been added to the queue that I created. So let me show you the queue. So if you see the queue, it will list the message that other file name that we have just uploaded will go into cues. This is my q and as you can see this image has been added to the queue now, I will process this image and the way I'll do it is like this that the image will be fetched from the queue and then the link of that image will be gone too and that image will go into the background of the website, right? So for that first, I have to change the code obviously, so I will go to my blog process website. Right and I will change the connection string. To the one that we are using right now. one second Right. So this is my connection string. I'll change it to what we are using right now. Right. And then also I have to change the link that will be accessing the file. I said this is the link that it is accessing. So the link has changed now because the storage account has changed right? So let me select the link for it. So I will go inside blobs. And I'll go inside the container. So this link is going to sew from from this point onwards till this point that is till the container name. The link will be same right? So let me copy the link and paste it in my coat and I'll show you what I mean. So if I paste the link here. So the linked live demo will be same and just the filename has to be fetched, right? So this is the this filename. I'm fetching from the queue. And what we'll do now is it will fetch the file name from the queue and we'll change the background of the particular website. Right? So if I process the page now that is processed our PHP what'll happen is it'll fetch the file from the queue and will change the background. Alright, so I have updated the the desert file, right? So it is showing the desert background now now I'll show you how exactly cues are basically used. So say I upload say three four files, right? I applaud this flat image and mind you the file the message that we just received would have been deleted from the queue. All right, and I'll just show you whether that is working or not. So I'll upload this flower file. It might take some time because if the files are kind of large, all right, so the file will be uploaded. Okay, it gave me an error. Let me upload again, so I'll choose a file. So sometimes when the size when the the size of the file is more it throws you in error, right? You can't do anything about it. So let me upload the file again. So once it is uploaded guys, I will be able to see it here. Right? So I have like three files right now. So it says velden block date complete and if I refresh it, I'll be able to see for three files now cool. So if I go to processed our PHP now It will not list me the previous file that I uploaded by the recent file that I just uploaded. So let me go to process. And now it will show me the image that I've just uploaded right? It will fetch it from the queue the file name and then we'll show me in the background. All right. The net is a little slow. Bear with me. Alright, so as you can see the file has been there the I'm getting some weird error way just because the net is not working, but forget this error guys, you can see you get the image in the background, right? So similar is the case now, let me go to my storage accounts. So we have discussed cues and blobs now, right? So let me go to my slides. So we've discussed what blobs are we have discussed? What cues are let me go to my file system, which is the best thing that I have. Figured out in this yard. So with file system it is exactly like blobs. You can upload any kind of file but with file system, you can actually mount it as a drive on your computer, right you can use it as it as if it was an extended Drive in your own computer, right but and also you get an Authentication Protocol with it, which is called the SMB 3.0 protocol, which is used by servers Whenever there is a file transaction, so that what Indication you will also get when you're using the file system and to and how you can mount it. Let me show you how so first of all, this mounting process is not available in Windows 7. It is only available in Windows 10 and above. So what I've done is I have deployed a virtual machine in Azure. Let me show you the virtual machine, right? So this is my virtual machine. So I have deployed Windows 2012 server on this now. What we'll be doing is we'll be mapping the file. That will be creating in a storage account in this particular system. All right, so I'll connect to it and now we'll ask me the username and the password so I'll specify the password. And I'll click on okay. Yes, and then I'll be connected to my system. So I'm in so this is my system guys. So if I go to my computer right now. As you can see there is no drive that is listed, right? So we'll be creating a network drive over here on which we can upload any kind of file. Now the way to do that is to first go to your as your dashboard and create a file over there create a file system directory over there, right? So we'll go to our storage accounts. So it is in live demo to double three six. And then we'll be going to files. Right. So as of now as you can see, there is no directory which has been listed here. So I will create a file shaver a share service and let me name it something else my drive, right and the quota is basically how many GBS of Drive do you want? Right? It can go two terabytes. But since I'm doing a demo, let me create a hundred GB drive right now, right so I create a hundred GB drive and I will click on OK. Alright, so my drive has been successfully created. Right, so I will go to this drive. And click on connect and then I will get this command to connect to it. All right, I'll copy this command. And I'll paste it in the notepad. So I'll use this in my so that I've just deployed now, how will I use this now? If you look at this command guys, this is the address of your server. All right. So this is the address of the your storage account and this is the file share that we have just created which is called my drive right the user name to access. This would be a 0 L / live demo to double 3 6. All right. And the password to the for this would be the key which has been specified here. Now. I have to specify everything in that. I've just mentioned in this server that I have created. All right. So the way you will map the map network drive is like this will go to PC. You will right click it and you will click on map network drive right now. It will ask us the drive name that we want to allocate it. So for example, we want to allocate the K drive to it. All right, and in this particular thing you will be putting in. Address of the server right? So let me copy the address of the server which is this. All right. I'll copy the address. And I will save it over here. All right, so it has saved it and now I will click on finish. So if everything goes well guys, it will ask you for the username and the password now the username would be this that is a 0 / live demo to double 3-6, right? That's why I go to my server paste the username here and then last me the password. So like I said, the password would be this your key. So I will copy the password. I'll paste it here that is in this particular field and I will click on remember my credentials and click on okay. So now if everything is authenticated it will go inside my drive. So as you can see I am inside my drive right now. And if I go to this PC that is my computer, I can see that a drive has been added over here. Now this drive in this drive as you can see the total size is hundred GB and the space free is under GB. So this is the quota that we assigned in file share while creating it right now if I want to copy any file over here, I can easily do that. I'll just copy this particular file and paste it here. Rachel easily copied and say I want to I want a shortcut to be copied and I can shortcut copy the short code as well because I don't have any files on this particular server that I can show that I can copy here. So as you can see the files have been copied are and these actually have been uploaded to the has your account as well. Right? So let me show you on the dashboard if these files are visible. So I'll go to the has your dashboard and this is my drive if I refresh it right now. Refresh so it will last me all the files that have just uploaded. all right, so it is taking some time and So basically when you create a network drive in your own computer it is as if you are using your own driver on your local computer if your internet and truck is good, right? So as you can see we have added these two files in our directory in the server and you can view it here as well and you can download it from here. You can click on it. You can download it and anyone can download it if they have the link. Alright, so we are done with file system. Let us come back to our slide and discuss our last component of A which is tables now tables is again an amazing service from a 0 so it is just like nosql but it is basically you can say a child of nosql. You cannot do complex queries on it. Now the way or the advantage of using tables is that say you have a data within which the structure is changing. Dynamically you what I mean by that is say you are entering you have a form you have created a website in which it except three things. Is it accepts your name? It accepts your mobile number and it accepts your location. All right. So once it does that it will upload it in the database right normal as usual. But what if tomorrow I use case comes in where in I want to add one more field, which maybe is asking for your credit card number, right? So if it is asking that if you were using traditional systems, you would have to go to your database and add one more column and then go on to chase your That interface and your PHP or whatever scripting language you're using but with tables the thing is that you don't have to change anything in the back end as in you don't have to change anything in your database. It will it will automatically adjust according to your data and create one more field, which is basically at which is basically you're trying to ingest for example in our case. We are trying to ingest the credit card number as well. So it will do that automatically. So let me show you how you can use the table service. So we'll come back to our dashboard and go to storage accounts, right and again in in your storage account. You'll have all the services listed. So we will select tables will go inside tables. Right, and once we are inside tables will have to create a new table. So let's name this table as a new table. Right and we will click on OK so my table has now been created. All right. Now the way you can upload your data to this table is the same you just copy the connection string you call the API and you can upload your data but to view the data in the table, you will need your Studio. All right. So let's for this is one table that I created earlier. So for adding it I'll show you how to add it. But first, let me add some values inside this particular table. That is my new table, right? So there is nothing inside it because I just created it. So what I'll be doing is I will be going to be showing you the website through which I will be uploading the data into the table. So it is this so this is my website using which I will be updating the table right now the way I will be doing it is I'll be first changing the connection string. So the connection string can be found here. Right? I'll have to change this. This is my connection code for tables will have to change the default connection string. So let us quickly change it this is my connection string. I'll come back to my code based at here. Add and remove the end point. Cool. So my connection string has been given now I have to change the table name as well. So my table name is new table. right and All right, so nothing else has to be changed. Cool. So our code is done now. I'll come back to my slide and refresh it. All right. So now there are two things that you have to understand that they're in a table one is called the partition key and one is called the Roki right? What is partition key? What is rho chi let me explain you. So whatever files that you're trying to store in your table are stored in different nodes when I say nodes. There are basically different servers right now each. Over will have a partition key which can identify it. So say there is a over one server to server 3 and server for all right, so I want to store my data in server 1. All right. So my particular type of data that I want to store in server one. So for that the partition could be partition key would be one right now inside my server every row has to be identified by a unique identifier and their incomes in the Roki. So this row Keys should be unique to each and every record that you'll be putting inside. Add a partition key table that is inside that particular server. If you change the server again, the Roki can be same as that of the previous server. But when you're you are creating records inside one particular partition key the rose key value has to be different. All right, having said that guys so we have this website and we have created a new table over here. All right. Now what I will be doing is I will be mapping this new table in my visual studio. Now the way to do that is open your Visual Studio go to server Explorer and once you have you will be listed your Azure service over here. All right. Now, I have to map my particular storage account on this Visual Studio as well truth. So the way to do that Is in the storage section click right? Click it and click on attach external storage. Alright. So once that is done, it will ask me the account name and the account key. Now the way to attach it is like this that you will go to the table service. So your storage account. You will copy the name based in the account name and then your connection string. Sorry your key, right? So in this case, you'll be copying the key and you have to pace the key here. Remember the account key so that you don't have to enter it again and again and click on. Okay. So this will add your Storage account over here, right? So this is my storage account live demo to double three six. Right. So my storage account has now been added and inside it. I have created a table. Call the new table, right? So if I click on the new table, as you can see there is nothing that has been added as of now. So what I'll do is from my website now, we'll add a new value. So I have already specified the partition key as default. It is called task Seattle, right? All I'll be doing is I'll be entering the name over here while touring the Roki over here, which will be unique. All right. So as as of now, there are no record, so I'll enter one as much as my arrow key and now lender the Columns that I wanted this row this particular row is the number is the columns and this is the value that that I want for that particular column. So for that I was for example, I want the name column to be there right inside the name column. I want the name he month. All right, I'll specify that and say I want my mobile number to be there. I'll specify mobile and know right and I'll specify the mobile number here. That is 1 2 3 4 5 6 7 8 9 say and now I'll click on upload data. So this will upload the data to the table that I've just created. So if I go here go back to my visual studio, and I refresh it. I'll be able to see that new record has been entered in which the Roki is one write. The name is hemant. And the mobile number is this now say I want to add one more field, which is asking for my credit card number. All right. So as I said the Roki would be different now. I'll enter the name so whatever column you have. It is specified. It will go inside the same column. So I have already specified name, right? So if I enter the value Heyman here, it will not create a new column and enter the value hemanth over there. It will just create then column, which is new to the data. Alright, so the mobile number is again say five six, seven eight and now it will ask me for my credit card number. Right, so the credit card number could be this. All right. So now if I upload the data. And I'll show you how it looks now. So as you can see now the credit card number of feel has been added. So the for the first record there is nothing there in the credit card number field, but in the second record, I have added that I want this data right also guys, you can specify in any order. There is no specific order that you have to specify right so I can enter the name first right and then I can enter the credit card number. So this is the credit card number that I want to add. Write and say I'm entering the mobile here. Right if I upload the data now, so this is required. Sorry three upload data. This data will be updated and if I refresh it now. You can see that. Okay, so m capital and M Small. You have to be careful of the of the indentation of the sorry your syntax as well. So whatever column names you're specifying it is case sensitive. So like you can see I made a mistake here by specifying a small C and it created one more column. All right, but as you can see the name is in the same column now. All right. So what in in whatever sorry in whatever sequence you can add your record at that record will be added automatically in its respective column, right? So this is how tables can be used. Alright guys. So with that I think we are done with our services. So we discussed what are blobs we discuss what a cues but discuss what our file systems we discussed what our tables and for each of the service. We saw how we can use them in as your and how we can deploy them as well. So let's go ahead and see what all we are going to learn in this today's session. So today in this session first, we'll start off with what is a virtual machine right? We're going to understand What is a virtual machine how we can configure it how we can launch it in Azure. Once we have done that we will move on to Virtual Network. So before understanding what is a virtual network will first understand. Why do we actually need a virtual Network? Right. Once that is done. We move on and see what is a virtual Network exactly and its components right and towards the end. We'll be doing a demo. We're in like I said, we'll be deploying to servers which will be configuring from scratch. That is a web server and a database server, right? And we'll be deploying them in Virtual networks and configuring their properties. Right? So guys, I hope this agenda is clear to you. Let's move ahead and start off with a first session which is what is a virtual machine. So what is the virtual machine? So I'm a virtual machine is basically a raw server that you get from your cloud provider that raw server could could be an abundant machine. It could be a Windows machine, right? So it's basically just like your own personal computer rather than purchasing it. You're renting it out. Load right menu renting it out on cloud now. It is the same as if it was you on your own computer, right? So it's a fresh piece of operating system. You can install as many software's as you want. You can want it to make it to be a web server. You can make it to be a worker tear environment. You can configure it to be anything. Right? So today we are going to make it a web server and a database server. Moving on guys. So this is what virtual machine is all about. And also if you compare it with AWS, which is also a popular cloud computing service with in AWS. This this same service is called easy to all right in as your it's called virtual machine in AWS. It is called easy to All Right Moving ahead guys. Now, let's start with virtual networks and first understand why do we actually need virtual networks? All right. So like I said, we have virtual machines, right? So if you say launch Watching machines and you want both of them to communicate with each other. For example in our session today in our demo session. What we'll be doing a is that we'll be deploying a web server and we'll be deploying a database server and we want the web server to talk to the database server right for this for this communication. We need a channel and hence. We need a network right but why would she will networks? So if you guys would have noticed in Cloud there is no there are no wires. There are there are no switches. There are no routers. It's all right. So your virtual machine is connected using a logical connection, right? It is logic these two servers are logically isolated and that is why we call it virtual, right? So this is so we understood that for the communication scale sake we need a virtual Network. Let's Now understand what a virtual Network exactly is. Right. So a virtual network is just like a representation of your network, but on the cloud, right? So for example, we launched a server on the cloud and we connect to our virtual Network. Right when we connect to our our virtual Network that is on as your our network will include that server as if it's on our own network that is on on-premise, right? That is what a virtual network is that is how powerful a virtual Network guilt right your server will be on the cloud but your Or your company's network will feel as if the server is on your own network, right? And it's like I said, it's a logical isolation of the Azure Cloud dedicated to your subscription that is whatever resources that you have launched in the cloud it logically isolates it from the rest of the resources that are there on Azure that maybe it could be your resources or someone else's resources. Well it logically isolates them and they are insulated to other resources. It doesn't matter if the other resources are failing or doing anything, right? They are all isolated. So this is what a virtual network is all about. Now when we say what your network is it basically has a lot of components. Let's understand these components. So the first component is Anna's your subnet. Now what is energy or subnet? Basically when you divide a network into sub parts it is called Anna's your subnet. All right. So when you divide a virtual Network in a box, it's called subnet. Now. This subnet can actually be given unique properties. Example in this same virtual Network. You have three virtual machines, right one module we're seeing is in one net1 subnet and the other virtual machine is another subnet but this subnet you can configure to be unique. For example. We wanted to we want to create a public subnet. So a public subnet is basically a subnet which has internet access. All right, so we can configure the properties such as in a way that this particular net the machines in this particular subnet will have the internet access. And the others particular subnet will not have the internet access so our subnet which doesn't have the internet access is called a private subnet. All right, so the virtual machine in this particular subnet will not have internet access. But but when you actually see it from a broader perspective, all of these servers are on the same network, right, but because of because of the subnets because the properties of subnets they reflect different properties, right? So being on the same same network they have different. What is and using subnets? This is how subnets are actually useful, right? So this is what this is all you need to know about subnet Skies now with subnets the properties that I was talking about say I want to connect to a web server, right? So for connecting to the web server for accessing that website, I need to go through HTTP protocol. Right? So all of this is configured in a in a firewall now, what is that firewall called that firewall is actually Network Security Group. Oops. Now what our network security groups? Like I said, they're just firewalls in which you put in the properties that you want the subnet to reflect. For example, I want to connect to my web server. So I have to allow all HTTP traffic on that subnet and for that I'll have to attach that particular network security group. So that subnet now I know it's a lot to take I just explained to you three components and you might be thinking where which component goes. We're right. And so I have this diagram. So I'll just summarize what I just Spin it to you. So we have this virtual Network in the virtual Network. We have subnets and a subnet is attached to a network security group right through this network security group is where you will be configuring all the protocols all the properties that you want your your particular machine to reflect. This firewall will be attached to the Subnet in which you will be deploying your virtual machine. Alright, so this is a place where you'll be deploying a virtual machine and it Will be attached to the subnet sorry our network security group and this subnet is actually included in your virtual Network. All right, so both these subnets are actually in your virtual Network. So one virtual network will have as many subnets as you want and each subnet will have different properties because of its network security groups moving along guys. Now, let's so enough of talks. I have explained you everything you need to know. Let's go ahead and start with a demo and for that let's look at the steps that Going to do so first, we'll be creating a network security group. That is the firewall that is required for a server. So basically we'll be creating to 5 volts one for a web server and one for a database server, right? So let's go ahead and do that. So just give me a second. I'll go to my has your dashboard. All right. So guys, this is how my dashboard actually looks like now on this dashboard. The first job that I have to do is to create a network security group. So let us do that. Let us go to the search bar and type network security groups. Right, and once you've done that you will see it is listed over here. We click on it. And then we'll click on ADD. Now when we click on ADD, we first have to add the firewall for web server, right? So it is your choice either you could deploy the web server first or your database. So you type in the name of the network security group that this is for my web server. So I'll type in web server. Then I'll have to assign a resource Group. Now, what is the resource Group? So basically like for our use case today will be deploying a lot of resources, right? So it becomes easier for us to manage it if it comes under Group. All right, so we'll be creating that group over here. So say I'll name the group as life - demo. Alright, so this becomes my Resource Group and all the resources that I'd be launching today. Will I will include them in this particular group so that I it becomes easier to manage for me. Alright, and I'll pin it to dashboard and I'll click on create now while it is being created you would have noticed that I have pinned it to dashboard. Now. What is the dashboard guys? So for those of you who are not acquainted with the as your dashboard so dashboard is just like a desktop guys that you have on your computer. So all the shortcuts are created here because I would be On Figueroa figuring all the properties. So I want it to be listed here. And that's why I have created a shortcut on the dashboard. All right. So while it is being deployed, let's deploy our second network security group as well, which is for my database, right? So I'll click on ADD. And I'll type in database. I included in the resource Group that I've already created, which is live demo. I click on this. I will pin it to dashboard and I'll click on create right that is it. It's pretty simple. Just enter the name the resource Group that you want to enter it in and created right. Now. One thing that I want you to notice is guys have not configured any property as of now, right? I'll do that later. So as It's now. I just created two firewalls with the name web server and database now. What I'll do is let me come back to my slide to see what we'll be doing next, right? So step two is create the virtual Network. So now I will be creating the virtual Network in which I will be deploying my servers right? So let's do that. Let's create a virtual Network. So I'll click here. I'll go to Virtual Networks. I'll click on ADD. And I'll give the virtual network name say v-net, right and then comes the address space. Now. What is the address space recipes is basically the number of IP addresses that your network can hold. So as of now this virtual Network and hold 256 computers, right or 256 virtual machines now since I'll be creating more than two subnets. I want to address space which will be more because each subnet will take some minimum value, right? So let us give it a more elaborate address, please. Let me type in this. Write and edit this part and this will give you a bigger set of addresses to deal with. So now my address my virtual network will be capable of gaving 65,000 addresses, which is kind of cool right next. We have this subnet name. So by default when you create a virtual Network, there will be a default subnet will be created which will be created. Alright, so this is the address range for that. Default subnet, so it should be in the same range that we have specified for a virtual Network. So let's give it this address and as you can see in this particular subnet, that is the default subnet. I'll have around 256 machines. Alright, so that is it. Nothing else needs to be configured. I will include it in the resource Group that I've already created that is live demo and location is basically the place where the servers are being deployed, right? So by default its best West us will keep it at that right and we'll create this virtual Network. That is it guys nothing else to be configured for as of now. This virtual network does not have any subnets, right? We want we want a web server subnet and we want a database subnet that will be deploying now. Once the virtual network is ready. All right, let me come back to my slide and show you this diagram. So this diagram basically talks about a virtual Network to subnets. Now. What I'll be doing is I'll be launching two virtual machines and I'll be attaching these virtual machines with this. It all right, and this is basically your network security group. This is where you'll be configuring your properties. And this also I'll attach to the subnet. Now this VM will then reflect the properties of this particular firewall, right? I will not be attaching this firewall directly to this VM, but I will be attaching it to the subnet. Now. What advantage do I have in this is that say I launched three servers in the subnet, all of them will reflect this property right so I don't have Have to configure them separately. All of them will be reflecting the security groups properties of this particular subnet. All right, I think a virtual network is ready. Let's see. So if I go to my virtual Networks I see that I have my watching Network ready. All right, now I'll go inside my virtual Network and now I'll be deploying the subnets. So we'll go to the subnets pain will click on ADD and let's add our first Subnet which is the web server subnet right. Now. This web server said net will be attached to a network security group which will be for the web server, right? So we'll attach a network security group for the web server and will click on OK. There is a it's that simple just add the subnet at as a network security group to that and you're done right? Similarly. I will be deploying the database subnet now, and I'll go to network security groups. I will click on the database subnet Database Network Security Group. I'll click on OK. And Bam, I have one more subnet. Let me go back to my dashboard. And see what all do I have so I have the two network security groups. I have deployed in Virtual Network. I have deployed the subnets in it and I have attached the firewall to the subnet. All that is left is now the BM so step three is create the web server virtual machine and the database virtual machine. So let us do that. We will go to our pain go to Virtual machines. right click on ADD And with this you will get this page where in you have all the operating systems that you can set in your in your virtual machine now, you can set a 1 2 operating system. You can also configure a Windows server, but we will be dealing with a 1/2 today right? So I'll select Ubuntu I will click on Create and then I get this page where I have to enter the general properties. So I'll I'll name the server as web server. Right. I'll give the user name. The user name that will authenticate me to this particular server. Now when you talk about the password or the way, you will authenticate yourself you basically have two options. You can either authenticate through a public-private key or you can authenticate through a password. So password is more easier. And since we want our things to be done quicker, I'll give a password and this is the password. I'll configure it now. And that is it guys. Nothing else needs to be configured Resource Group. I'll give the resource Group that I've already created that is live demo and I'll click on OK. On the next page it will ask me the configuration of my server that I want, right. So do I want one course review and a 3.5 GB Ram or I want to two core CPU and 7K Graham. I can choose all the configuration which are available here in the view all page, but I'll stick to the first configuration which is the basic one so that because I'm doing a demo right so I don't need a big machine for it. I click on select. Next comes the optional features that I have to configure, right so the storage and then what virtual Network do I want my server to be deployed in so we have created the virtual Network called v-net. So we will be deploying it in this then comes the subnet. So inside this virtual Network, there are three subnets. Like I said one is default that is created by default and then we have the database and the web server subnet. So since this is a web server VM we We'll be deploying it under the web server subnet then comes the public IP address. So it will assign it a public IP address through which we can access it that is going to be new and then comes the network security group. So since we have already assigned a network security group in the subnet, we don't need any network security group to be attached over here. So we'll click on none and then monitoring do you want it or not? I would prefer to be disabled because I won't be needing the server after the sessions. So I'll click on disabled and I'll click on OK. All right, so now what will happen is it will validate all the properties that I have entered and once it has entered it will give me a page where in I have to agree to the terms and conditions and that is it. So I'll agree to the terms and conditions and I'll click on purchase and that will deploy my server. That is it guys. So this is my web server being deployed. Let's quickly deploy our database server as well following the same steps that we have. Load now, right. So I choose open to machine. I will click on create I will go to this page and type in the name of the server, which is database. Right the username. So it said Eureka authentication type is password. So I'll type in the password now. Confirm the password. And then comes the resource Group. So it's live demo. Right? And the location is Vesuvius. I click on OK select the most basic configuration, which is the first one click on select. Now I'll be configuring the virtual network settings. So subnet would be database. Right Network Security Group will be none. And that is it monitoring will be disabled. Click on OK. It will validate all the properties and then I shall purchase the server and which will be deployed. Right if you if you're talking if you are thinking how much is it going to cost me? So each server is going to cost me around three, three, two, three, two point three point five rupees per our right. So that's like a fraction of a dollar. So I think if you're learning as you're that is worth it, right, so my servers are being deployed guys now why my servers are being deployed let me Properties of each other right? So let me go to the web server firewall and configure the properties. So basically what I what I am looking at is the inbound security rules, so I click on inbound security rules. So inbound security rules are basically the rules which are created for the connections which are in coming to the server, right? So this is a web server, right? So for a web server first, you have to enable the HTTP connection. So I want the HTTP connection through HTTP protocol to be enabled over here. Right? And the source is any what what kind of people can access the server? So I want the whole world to end access my internet website. So the source is any the service is HTTP, right and everything else is default the action. What do you want? What do you want to deny it or you want to allow it? So I want to allow the connections. So I will select allow and I'll click on OK. Alright, so my security rule is being created. So while this is being created guide guys, let's will have to add one more security rule which is the HTTP security rule because our websites connect with two protocols, which is HTTP and https. So we will configure HTTP as well. So let's let us select HTTP from the list headers and then the action is allow and you might be wondering what this priority number is, right? So priority number. Is basically the number which will be given to your rule. So say example in my previous rule. I give the priority number as hundred right? So when it reads the set of rules that are given in the firewall, the first rule would be the least number which is there. So the least number is hundred and it goes up to I think 900 right? So it will read all the rules according to the numbers and then configure them. So we have added the HTTP Rule and the HTTP rule is also being added and that is it that is all is which is required. So, let me just refresh it and I can see their HTTP and https rules are already been given now. I also want to SSH I should be able to SSH into my server. But before that let me show you what if I don't configure the property are let's see what that then happens, right so for configuring my web server. I have to SSH into the web server to see to install all the software's which are required for that particular. So right so let's connect to the server. So the way I can connect is using a software called Petit. So I launch the software I paste this piece IP address here. And as of now guys, I have not added the SSH property, right? So if I try to connect it will show the screen and it will be it will keep Keep on pointing here, right? So the connection will time out after a few say 30 or 40 seconds and it that basically means that the server is refusing any connection to it. And the reason for that is that I'm not configured in my firewall. So to do that see as you can see it has given me an error which says connection timed out. So to do that. I will have to go to my firewall which is the network security groups of my web server. Right. I will go to the inbound security rules and now I'll add a rule for SSH. So once I add the rule I will be able to connect to my service. So it's done by security rule is being created and once it is created I will be able to SSH into this. So also it takes some time for that rule to actually be applied. Right it says that it created a security rule but sometimes it takes time to reflect. Let's see if the rule is being reflected here. And yes, the rule is being reflected. So as you can see I've added the SSH Rule and now it is giving me the login page. So I login into my server which with the username Erica. I configured the username to be at Eureka and now it's last me the password after authenticating the user name. So I will type in the password. And if everything goes well, I'll be authenticated to my server, right? Yes, so I am in my server. So this is my 1 2 server, which is running on Azure Cloud. Now, I need to configure the software's in it so that it becomes a web server, right? So as of now there's nothing installed on it. It's a fresh piece of software. So let me first update this Ubuntu. So I'll type in the update command. It's sudo apt-get update. Right now it'll take some time to update mean by guys. Let me quickly show you if I can access my web server as of now or not, right? So I'll go to Virtual machines. I'll go to web server. Now. You might ask me that we have already configured it to accept HTTP connection. But still if I try to connect to the server I will not be able to do so, it will return me empty response screen. So this basically means that there is nothing configured on my server as of now. So what I'll do is so my Ubuntu is now updated. So what I'll do is now is I'll update it with the Apache software, right? So I'll type in the command for Apache so sudo apt-get install apache2. All right, once I've done that it will install the Apache software here. And within seconds you can see that I'll be able to connect to the server. So it's starting the service processing? Yeah, so a patch is installed now if I try to connect to the server you'll be able to see that I am getting the Apache screen. So if you want you can connect to the server. The IP address is 40.82 3.14 TDOT hundred my team will be handing you out this IP address. So I'll repeat it. Again. It's 40.82 3.14 TDOT hundred you can go to this link and you will see the Apache web page. As of now now as an as we will go along and we'll update this thing this website, you'll see that this page will be updated. All right, so I have the Apache working on my server now now my website that I have created it is actually a PHP website. So laughs to install PHP on This Server as well. So I will write sudo apt-get php5 and I'll have to install it. So this is it this is it one second. So I misspelled install my bad. Sorry, right. So now my PHP will be installed on this system. And while this is being installed guys. Let me show you how my website actually looks like so I'll go to localhost and I'll type in the A dress for my website. All right. So this is how my website actually looks like it's pretty simple. You just have to enter your name your email your mobile number your location and once you click on submit all of this address will go to mySQL. Now MySQL is in a different server. This will be in a different server. And what we're trying to do is we're trying to authenticate them to each other using virtual networks. All right, so if I go to my web server, so my PHP has been installed and with PHP. I also need an extension which will be which will It to connect to mySQL. So for that I will have to install that extension as well. So sudo apt-get install PHP 5 - MySQL, right? So with this my extension will get installed on the system and that is it. Alright, so my web server is configured now, let's go on and configure our MySQL now, right so my skin is a bit tricky guys because you have there is a lot of configuration that you have to do. But let's hope for the best and see if you can connect to it. All right. Also guys, if you would have noticed I'm not configured anything for my server from a database server. So as we did in web, so I will show you if you try to connect to it as of now will not be able to so while this is being loaded. Let me quickly go to the properties of my database server. Right and include the inbound security rules according to what I want. So I will first have to enable the SSH rule, right? So this is how I will be able to connect to my server. So I'll select the SSH service. The action is allow. I'll click on OK. And my security rule will now be created. Also I should also be able to create a MySQL connection to the server because I want this this server to be accessed through my computer, right if I write a for example, I will be creating a database I will be adding the table, right so I won't do all of that through my computer. I don't want to SSH into the Ubuntu again to configure anything. So we'll be doing that. So we need a MySQL connection as well. So let's That so it would be MySQL. And the service would be MySQL. Action is allowed I click on okay. And this is it guys. So now the security rule will be created and if we try now to connect to our database server, I will be able to do so, so I will copy the IP address. I will click on open. I'll say yes, and now it will ask me for the login name. So as you can see the security rule worked it is asking for the login name and now the password so I'll give the password for this. I'm done with this. I'll be authenticated to my Ubuntu Server. First of all, I'll update this machine with the update command like we did in the previous over as well. Right? So now it will be updated after this. I'll install the MySQL service that we'll be using to that. We'll be using to connect our website from right so I will now install the MySQL service which is sudo apt-get install MySQL server. Right. This is it. I type in by which means yes, and now it is a still ask me for the password. I'll type in the password and confirm it again. Hit enter and that is it. Okay, so now I've configured MySQL. I've installed my skin on my system. The next thing is by default MySQL only allows the Local Host to access the root user. Right if I want to connect through my machine. I have to create one more user for MySQL for me to access it. Right. So once my MySQL is installed I'll show you what I mean, right so we'll be doing that. And I think we are done. Yeah, so we're done. So let's connect to a MySQL service now. So the user is root and the password was a Eureka one, two, three to connect to my database and we are in so like I was saying we have to create a user that will that will be accessing from so let's create a user for MySQL. So I type in create user say the user name is Ed Eureka for my database whereas it is on localhost. And I should add the password for it. Let me add the password as Ed Eureka 1 2 3 right? And let me deploy this over. So I've created the username now. I'll have to Grant all the Privileges to this particular server. So let me give the command for that. So it's Grant all privileges. On everything that is there on this database to this particular username, which resides on localhost. So this is a command that will be configuring or right now same set will be configuring for the percentage host. So let us do that as well. All right, and then Grant all the Privileges for the same. All right, so done. So we have created successfully a new user now. If I try to connect to this database using this user, let's see how we can do that. So I'll dive in MySQL. So previously I authenticate myself using route. But now I'll use the L Eureka username and see if I can connect to it. Sorry. I misspelled it. So it said Eureka - be and now the password so as you can see I am I cannot authenticate through. Alright, sorry for that glitch. All right. So now what we'll be doing is we like of a saying so we have to configure one more file for a MySQL to get configured right? So for that let us go to our directory. That is e TC. And in that MySQL right now in this particular directory. I have a file called my DOT c n r so this is the configuration file that I'll have to concur configure for connecting to my MySQL. So I'll sudo Nano into it and then I will get To this particular statement, which says buying a dress. So this binary dress be statement basically says that only localhost connections are allowed to my MySQL right? So I'll have to comment this part out and then I will save it. And there is a guy so this was the last setting that I had to do now if I try connecting it through my computer. I'll be able to connect to this particular MySQL instance. So how to do that there first. I have to go to my MySQL installation folder, which is somewhere here. Right. So let me quickly go to my folder. So this is the folder where MySQL resides so now I'll connect it using this particular command, which is MySQL - eh now I'll paste in the IP address the username, which is L Eureka the port number which is 3 3 0 6 and then the password it will ask me for the password for the password is a Eureka one, two, three now mind you guys it will not connect right now. It will give me an error that it can't connect to mySQL. Service, and the reason for that is that we have configured everything after the MySQL service started on my server. So now I'll have to restart my server to connect to it. Right so it will take some time and then it will throw an error that it can't connect to the particular MySQL server, right? So as you can see so for now connecting to it we will have to Restart the service. So let me restart it by typing in sudo service. MySQL restart All right. So with this command my MySQL will get restarted. So let's see. So my MySQL has stopped and now it has restarted. And now if I try to connect to a MySQL server. I will be get yes, so I have it on my computer. Now. I am able to connect to my MySQL server. Let's quickly create a database for my website, which is create database entry. So I quickly create a database and I'll create a table for this, right. Which is create table entries. I will give the name. And then the second entry is email address that is work at 30. Right and then the location which is again where car 30? And then my mobile number. Which I'll be feeding here. Alright, so I think the net is giving some problems. All right, so I didn't select the database soyuz entry. And then I will create the table. So guys there is some problem with our internet connection. I think it is residing on your end as well. So what we'll do is we'll continue this session in our next video. So we have created the database now next is creating a web server that will do in our next session. All right, so let me quickly come back to my slide. which is Here, right. So we have created a VM for the web server. We have created a VM for database. We have configured a database you can connect to a database to our computer. All that is left is configuring the web server. So we'll do that in the next section and I'll show you how you can configure the properties for it today in this session. I will show you guys how you can configure the web server. All right. So let me quickly go to my as your dashboard. Alright guys. So this is my as your dashboard. And for those of you who are new I will show you how you can deploy a virtual machine. I've already deployed one, but let me quickly show you how you can deploy another virtual machine. So in the in the dashboard, you will go to Virtual machines. You will click on ADD and then you can give the nerve the you have to choose an operating system. You choose your operating system. You will click on Create and then you'll have the In where you can fill all the information right once you fill in all the information, you just have to click on OK and in the last part It'll ask you to agree to the terms and conditions you can do that and your virtual machine will be deployed. All right, so I've already deployed one virtual machine that is for my web server. Now in the web server, you can see these are the properties that I have attached to my web server. So this is basically my network security group for my web server in this. I have configured that my web server. Can we should? Of HTTP connections should have https connections and an SSH connection right now. If I want to add more properties to it I can add by clicking here that has that is inbound security rules. I'll go here. I click on ADD and then I can add any property that I want from this list that is available here. Right? So I've already added the properties now, what I'll do is I will SSH into my web server and see how we can configure it. All right. So this is my web server page. So I've just gone to Virtual. So if you go here in the virtual machines tab, you will find all the virtual machines that are deployed over here. I selected my web server and then I reached this page now. I need the IP address of my virtual machine to connect to right. So as of now if I copy this IP address and paste it here. You can see I cannot connect to my virtual machine as of now because there is no nothing installed on this web server. So what we'll be doing now is we'll be installing the sort necessary software's for my virtual machine to work. Alright, so I will enter the IP address here and I click on open. And it'll ask me the login name. So I'll give the login name that I have configured. That is ID Rekha now to last me the password, so I'll enter the password that is this. And by disconnecting let me show you that as you can see the page is not working as of now. So we will install the necessary software here and then we'll try again to connect. So if you guys want you can actually connect to this website the IP addresses 13.9 3.20 9.3 eight, right? So my team here they will they will put it in the comment box for you to access you can go to this IP address and you can see that as of now we cannot connect to this particular website. Alright, so now So this is the wind machine. This is my server. I will install the necessary software. So I'll pseudo updated first. Alright, so my updation is being happening. And now I will install the PHP software. So my website for that, I want to deploy on this particular server. Let me quickly show you the website that I want to deploy. So it's hosted on my Local Host as of now. Right, so let me go to my website. So here it is. All right. So this is my website guys. I'll enter a name and email address or mobile number and a location I click on submit and it will enter all these values into the mySQL database that we created yesterday. All right, so I'll show you how the values that will be replaced reflected in the MySQL. But for now, let's configure web server first. So this is the website that I will be uploading to my web server. But first I have to install the necessary software. So this is the PHP website guys. So I'll install the PHP software now. So zile sudo install the PHP. All right, so it will install the PHP now. And then we can go ahead and now since my website has to interact to mySQL. I also have to install an extension for my MySQL to work so I don't do that as well. Once this is done. So, yeah, so my PHP is installed now, I will install the extension for my PHP MySQL so to do that pseudo install. the PHP extension which is this so I misspelled it one second. All right now for all of this to work, I also have to install the Apache server. So let us install the Apache server. So like I said as of now we cannot connect to it. So what I'll do now is install the Apache server so sudo apt-get. install Apache All right. So now if I try to connect to my website I'll be able to do so, so let me quickly check my network security settings. So I will go here. I'll type in network security groups. And that will last me all the network security groups which are present as of now, right? So I have to network security groups. This is the new web server network security group that I have configured. So I'll go here. And as of now you can see only the SSH rule is there so what I'll do now is I'll install the Apaches. I'll configure it to allow HTTP connections. So to do that, I will go to inbound say security rules. I'll click on ADD and add the HTTP rule. It is I will click on low and I'll click on OK. Alright, so my security rule is being deployed. I also have to configure it to have the HTTP rule as well. So I will configure it to have the HTTP rule. I'll click on okay. And yes, I have the security rule for this as well. Now. Let me restart the Apache 2 service. sudo service party to restart Right, and if now I try to connect to my website. Yes, so I can see that a party to page is now working. Right? So if you guys will now try to access this IP address the Apache 2 page will start working. Alright guys, so now since our page is working. The next task is to connect through FTP and upload my website. So to do that, I'll have to First add the FTP rule in the inbound security rules. So to do that. I'll click on ADD. And in the name I'll type in FTP. Right, the service would be FTP and then the action is allow and I click on OK. So it is now creating the security rule. And once this is done, I will be able to connect through an FTP software that I had. This is called filezilla. All right, so you'll enter the IP address here your username your password port number for FTP connections. It's 22 and then you'll click on Quick Connect and then we'll have the all all the directory listing of that serve over here, right? So as I can see the FTP rule has been added. So now I will go to the dashboard. I'll go to my web server. I'll copy the IP address I paste it here in the host the username for it. That is either a car password. Let me enter the password. And now the port number I'll click on Quick Connect. Now it'll take some time to connect to the directory of my server. So now I have the directory. All right, so now I'll have to upload my website, right so for doing that I'll have to go to this particular directory. That is slash bash / www slash HTML. All right. So this is the directory where you will be uploading your website now by default. You cannot upload your website. So let me show you what I basically If I try to upload my files here. You'll see that I'll have an errors that file transfer has failed. So that is because over here we don't have the access right side when I cannot read write in this directory now for doing that. I'll have to allow myself to allow myself from the shell. So I'll do that. Let me cancel all the file transfer that are happening. All right, so now I will go here. I will type sudo chmod. - Capital are triple seven. So this will basically give me the readwrite access to this particular directory. And once I have that I can upload my files. All right, so this should be it now if I try to upload my files over here. All right. So now like I said if I will try to upload my files. It should uploaded successfully. So as you can see the file transfer has now started. Right. I don't need the index or - HTML. So basically, this is the Apache page that you were seeing so we can delete this page. Okay, so my transfers have finished. So now if I go back to my website and a try accessing it, I will be able to see the website that I just uploaded. Right? So this is the website that I just uploaded now. Let me show you the database server that I configured yesterday. So for that, let me open my command prompt go to my MySQL installation. So this is MySQL installation guy. I will type in the command MySQL - H and now the host name, right? So for the hostname, I need the IP address of my server. So for that I will go back to my dashboard and my database so which is here. I'll copy the IP address from a database server. I will paste it here. And then the username which is at Eureka the port number which is 3 3 0 6 and then the password. All right, so it lasts me the password. And with this I am there inside my MySQL shell now this MySQL shell. I have created a database called entry. So let me show you. So as you can see, there's a database called entry in this my all my website data will go right and inside entry. There's a table called entries. So as of now if you can see this table would be entry empty. Right? So this table is empty. Now my website will actually upload all the information that I be typing in here to this MySQL shell. So if you guys want you want to try this website out you can go to this IP address. S you can type in all your information click on submit and it will get reflected over here. Right? So before that before you could actually do that. Let me change the index file, so I'll have to update it with the IP address of my server. Of my database, right? So for doing that, give me a second. I'll go here in the host name. This is the IP address that I have to change. I'll change it with the IP address of my database server. So I'll save it. And now I override this in my soul. So I take this file index dot PHP based it here. Now, it'll ask me whether I want to overwrite the file. So I'll say okay. And now it has transferred my file. All right. So now if I enter with details as in my name my email address. my phone number All right, and then my location? So now if I click on submit, it will enter the values in the MySQL. So now if I refresh my MySQL, I'll be able to see the entry which adjustment right. So this is it guys. I have configured my web server on the has your VM and we have configured it from scratches or so. You'll find there's a service in Azure called app service. So you could do that automatically all of this that is configuring your web server and everything. Just have to upload your code editor which would have installed everything but it's good to it's good to learn from scratch, right? You should understand how things happen in the background. And that is the reason that is the motive behind today's demonstration today. Alright, so with that guy's I will end today's session right? So let me summarize what we did. So we created a virtual Network. We created a subnet. We created a network security group. We created a VM. We attached the VM through the subnet and since the network security group was attached to the subnet rvm could access the properties in the in my network security group in my network security group. I allowed all the HTTP connections, right? I allowed the SSH connection. And that is the reason I could connect through SSH. Right? And that is the reason you guys could also connect to this website if you try to open it and in case I would have denied All the traffic from HTTP you guys won't have been able to access the website. And that is the reason we need firewalls. Today's topic of discussion is azure active directory. But before we do go ahead and understand what an active directory exactly is, let's start by taking a look at today's agenda first. So what do we have here first and foremost we would be starting things off by understanding what an Azure active directory exactly is and why it is needed. We would also understand what is the difference between Azure active directory and Windows Active Directory would also understand what are the different audiences this active directory caters and discuss water is different editions and also talk about what our Azure active directory tenants. Finally. I would finish things off with the demo part. Now when we talk about the demo I would be talking about how do you go ahead and create users? And how do you go ahead and create an active directory? And also be discussing quite a few other terms as well, but that is for the later part. Let's start by understanding. What an Azure active directory exactly is let us start by taking a look at the definition first. Now if I talk about the definition, this is what we have. It is Microsoft's multi-tenant Cloud base directory and identity management service that combines code directory Services application access management and identity protection into a single solution. Not the so many terms in it and so many things to understand let me simplify this definition so that you understand it in a much better way to do that. I would be giving you an example Think of it in this way suppose. I am a cloud vendor or not a cloud vendor. I am a service vendor and I reside on a cloud that means I have a particular application that runs on cloud. Now. This service is used by quite a few customers. Plus there are quite a few organizations that I have to interact with. Now in this case all these medias our customers and organizations, they have to communicate with me. So how do they do it? Well, what they would do is they would go ahead and create an account or maybe have some user IDs through which they can actually communicate with me. Now this is okay. If the number is countable or manageable Suppose there was a situation where we had a number of people and the number of people who was constantly increasing suppose. I have somewhere around thousand two thousand people. Now these many logins and these many credentials managing all these can be a huge problem. Let me give you an example. How does this happen? Exactly or what problems do you face? Normally suppose I have ten organizations now to log into all these or give access to all these ten organizations can be a used problem. Why all These organizations might have different kind of accesses based on that. I have to set in different security protocols as well. If certain organizations have an easier protocol. What if they get an access to other organizations as well or to the data that other organizations have to correspond to in that case. It can be a huge problem apart from that. I might have n number of customers and keeping track of so many customers can again be a problem when you talk about creating credentials. So all this is a huge problem. So what happened was Microsoft Azure, it went ahead and created something called. Azure active directory it is nothing but something that acts as a middleware it takes care of all the signs and all these things how now the users will have a single sign-on process. That means they would sign in only once plus they can have access to the applications that are there which I provide them. Now this intermediary that is active directory. What it does is it federates all the responsibilities of taking care of access and all those things. That is the way I set all the rules. It just incorporates those rules and accordingly it gives access to To all the users the simplifying all the complexities that I would face otherwise, so this is what an active directory exactly is. It basically goes ahead and simplifies all the signing in and user authentication processes or identification processes are there now as we move further we will be discussing quite a few other terms and you'd be having a clearer picture as to what I am saying. Exactly. But meanwhile you just bear with me and let's move further and try to understand what are the other points that we need to talk about. Okay. Yes. I did miss out on this point what Microsoft Azure does is it also gives you Thing called as a better platform where developers can develop the applications with a lot more ease again as we move further with by understanding this point as well. So what is the exact difference between Windows ad and as you're ready, let's try to understand that as well. When you talk about Windows 8 e that is active directory. These are the layers it has to take care of you have something called as your domain Services you have your lightweight directories you have your Federation services. Has certificate services and Rights Management Services as well. Now, these are so many things to take care of when you talk about your active directory with Microsoft Azure. It combines all these layers into to firstly you have your windows Azure active directory now, it is something that takes care of all the services that surround or revolve around identity problems. That is when you talk about identification management. This is the part that takes care of it. That is your W aad and then we have the other part where you have to actually go ahead and come. Get with other organizations. I give you an example of 10 different organizations needing 10 different things that is federating all these organizations your windows Azure access control services. It takes care of all those things. So both these so-called active directories the more or less serve similar purposes, but the approach in which they do is is completely different your active directory has more layered approach where every service is given a different layer or different way of handling it. But when you talk about your Microsoft Azure active directory it simply Sighs things your first layer takes care of most of the things and the remaining things are something that is taken care by our Windows Azure Access Control service. Also, when you talk about active directory, it uses something called as ldap for various other Communications, but when you talk about your Azure active directory here, you use something called as your rest apis again, the approach is completely different. So what are the audience's that are catered by this directory first and foremost we have I Edmonds now when I talk about it admins what Microsoft Azure active directory does is it provides in single sign-on for various applications now, they're quite a few SAS applications that is software as a service applications and various on-premise applications to which you have a single sign-on you do not have to log in every now and then now I've worked on quite a few applications and places where you have to log in every now and then you have a lot of trouble because you have to remember so many passwords and so many logins and these different credentials can be a problem. Now, this is something your Microsoft azure. Takes care of single sign-on is very convenient apart from that. It ensures strong identification and the quite a few processes that ensure this now I won't be discussing those points in detail. But yes when you talk about identification Microsoft Azure ensures that it happens in a very good manner plus it Autumn. It's quite a few processes again easing up this process apart from that. It also caters quite a few developers as well. Now I'm talking about quite a few organizations and since sign on becomes easier here. Your application developers can focus on building applications. And since they have access to so many organizations and so many resources application development definitely becomes easier online customers. Now people who have been working for quite a while. They might know that we have things like Office 365 or you have your CRM Services as well. Now you had an access to all these things by using your Windows Active Directory, but your Microsoft Azure active directory also gives you access to all the services that means if you are using or have account on any one of these things you can have access to all the services or have access. To all the active directory services that user has to provide to you. So what this does is it caters the needs of various online customers as well. So let us try to understand the next point that is azure active directory additions for that. What I'm going to do is I'm going to go ahead and switch into the Microsoft web page. Basically our I'm going to switch into my browser and move to the website and talk about all these points. So instead what I would do is I would first discuss the last point and Before we do go ahead and take a look at the demo than we would just go ahead and talk about these points as well so that we can directly such into the demo part. So let's move further and try to understand the next point and then come back to this point. So what our tenants basically now when you talk about a tenant it is nothing but an organization I just mentioned that we have tens of organizations that a particular application might cater now all these organizations are treated as tenants. All these tenants can Have access to a particular active directory or more than one active directory as we move into the demo part. I would be talking about how to create multiple directories as well. Yes, we can have more than one active directory will discuss this as we move into the demo part, but before that you just understand these points as in what I'm trying to say. Exactly. Yes, what happens here exactly is when you talk about a tenant first and foremost, it is nothing but an organization and it is a dedicated instance of your other active directory Service Plus. These are isolated instances that And as I mentioned we have ten organizations or five organizations could be having isolated instances for each of these organizations ensuring that they stay aloof and their services and their Protocols are maintained differently. This is where your Azure active directory steps in. It takes care of all these things. It ensures that nothing is ambiguous or nothing is intermixed. Everything stays separate plus each and every platform or organization gets serviced equally. Well as you move further would be creating users and then then I would give you the differences as in what a tenant is. How do you go ahead and create all the domains and all those things? So again into the demo part you'd be understanding these topics with little more clarity or more understanding other. This is the demo part. But before that as I've already mentioned, let me quickly switch to the website of Microsoft Azure and I would be discussing the additions that you can choose from and then we can directly jump into the demo part. Okay guys, so this is a Microsoft dog. Basically which talks about choosing an addition. So these are the options you have we would be finishing this quickly and then we would be switching into the demo part. So let's understand this now what Microsoft Azure does is it gives gives you various options first and foremost you have three options to pick from and out of these three options. The first one is your basic option that is your active directory basic. Then you have your premium which is P1 and then you have one more premium, which is P2 all these things provide you with different options that you have first and foremost. Your main job is to have your access that is your identity management your security and your single sign-on and all those things. Now, these are some of the services that come with your basic account as well. And also with your free account what Microsoft Azure does is for people who are completely new to the session and Microsoft Azure. Let me tell you that you have a free sign into Microsoft account. That means you can go ahead and create your account there and Avail these services for a certain duration which are available to you for free. So, yes, you do not have to pay anything there. You have a free account in that you'll be having access to some of these services but if you need Advanced Services, then you have to pay for it and for those things you have three options. Ian's that is your basic premium P1 and premium P2. Let's try to understand these one by one as in what are these and what do they have to offer to you now if you scroll down and if you take a look at this thing, you have your Azure active directory basic now this basic is nothing but it is designed for people who are task workers or who are focused on a particular application of on cloud and it takes care of everything your single sign ons your essays and it ensures that the security is 99.9% and it provides you with all these features which you can see here that is Yes, self-service password resets and all those things you also have access to quite a few things like your proxies and all those things. I won't be getting into the details of what proxies are and all those things. But yeah for people who are admins and who have worked on these topics are in these domains. They would understand what do these things mean? So yeah you have access to all these things which fall under your basic option apart from that you have something called as your premium P1. Now, this is for people who want to scale up. So when you try to scale up you'd be dealing with quite a few things and And terms like your I am and all those things would come into picture. Now. I am is nothing but your identity and access management basically, which is a very important point when you talk about active directories, so yes, it provides you with these things as well or these facilities as well like identity protection your security in the cloud and all those things. Everything is taken care of for this particular model. Now when you talk about premium P2, if I scroll down this is what you have. It is designed for more advanced protection. That means you'd be getting all the services that were provided in. And P1 apart from that you'd be having some additional Services which ensure more security that means it focuses more on privileged identity management. Now again, this is something that you can read and understand it is very easy. But to give you a basic difference your first thing provides you with your basic services, that is your basic access gives you basic active directory service access. Then you have your premium version which is focused for scaling up and when you talk about P2, it focuses more on Advanced security. So these are the three different editions that you can choose from now. If you are somebody who is belonging to a particular organization and wants to go ahead and use the services you can actually go ahead and read all these things and then go ahead and take a decision accordingly. Now, what I'm going to do is I'm quickly going to go ahead and switch into the demo part for that. I need to go ahead and open my Microsoft Azure account. So let's do that. Well, My internet is kinda slow today. So it might take a little longer while the normal I can click here on Portal and there you go. It would ask me to sign in I would be using a dummy account today for this so-called demo. I wanted to give you an access to our view to quite a few directories and all those things. So that is why I did go ahead and create an accountant or certain active directory is created or basically certain accounts created. Now, this is how the Azure portal looks like for people who are completely new again. You have your dashboard. Here apart from that you can actually go ahead and create quite a few things that is your virtual machines your data factories and all those things for people who want to know all those things. They can actually go ahead and refer the other videos that are there in the series and you know, quite a few other things as well. But as far as this session goes we are here to talk about active directory. So let's head into it and try to understand how do you go ahead and create active directories and all those things. Now, how do you navigate to a particular active directory now, if you scroll down here you would be seeing an active directory here for people who have an account on Microsoft Azure and Access to all these things they would have an active directory by default. So you just have to come here and click on it and a particular dashboard would open up for you people as well. Now. This is how it looks like you have all these things and overview getting started you have users groups, which you can manage and monitor you have devices. You can connect to your various app registrations as I've told you can manage multiple applications as well. Now in that case what happens is as I mentioned you might be dealing with multiple applications. So a particular user what applications should have access to What domains does he have access to what are the devices that are configured? All these things can be controlled or managed from here basically, so this is what you are so-called active directory does now, let's move further and try to create some users. Now. How do we do that? Well, I can click on this icon here and it would give you the list of users that already there as you can see the quite a few users here at this was our demo account. So we did go ahead and create so-called users so that you can have a look at them. This is something that I created yesterday. That is Chris Pratt. Now, how do you go ahead and An account I would be talking about all these things to give you a start. You have to click on this thing new users and this window opens up now again, I'll have to go back and show you something else. How do we deal with all these things? Well, first and foremost, you need to given a pseudo name or a name of the person for which you want to create a user apart from that you need a particular domain name or yes a domain name for a particular domain service. Now, how do we get that now these domain Services have to be registered with your so-called. Old Azure active directory so I have these accounts are right so I can use one of these accounts to just go ahead and create a particular user suppose. I want that user to be assigned or maybe associated with this ID so I can select this domain service extension basically again, click on new user. So what name should I give to this particular user now? I am a huge cricket fan and recently. I watched England's match. So let's pick a name of one of the players that belongs to. Sam Billings and again, this is where I would be creating. The user say I say sample as a pseudo name and I given this domain details that is at her a card TK. Now, this is something that is configured already. That is why I can use it and I can have an account if I used an ID that was not registered with this as your account. I wouldn't have been able to create this user because it would have given me a particular error as we move further. We would be taking a look at that as well. But for now, let's go. Ed and create a legitimate user that is this one now it verifies whether the name is proper or not name is something you can use in any which way you want to but your username has to be legit and valid so I have these details which I've been turd configuration not required properties can be default. And if I have to assign him a role I can click here you can see the name is verified here as well. Let's make him a global admin maybe and again you'd be given a password Here If you say show it would show you the password and I would suggest that you Note it down because you would be required to go ahead and login and in that case you might be needing this password. So a suggestion that you noted down. I say okay here and I create the user now. It might take a while because at times there are certain things that take awhile. But in this case, it has happened pretty quickly. So as you can see we've gone ahead and created a user his name was sampling if I'm not wrong. So yes, do you have this account which is sample and if you click on it and open it you can have access to to that account where you can enter another details what applications that are. They under this user and what applications do you want to assign? Which devices do you want to configure and all those things? If you scroll down you have some other options as well sign ins and audit logs now, I won't get into the details of these things, but you can assign all these things to this particular user as well. So yeah, this is what the user looks like and you can actually go ahead and log into this as your account through this user profile as well. We can do that. What I'm going to do is I'm going to go ahead and create Or open an incognito window where I'm going to go ahead and log in as this user. Let's just say Cognito and Now if I try to login, I would have to enter in the details. I've actually gone out and tried logging in but I fought in the credential detail. So let me just quickly switch to this window copy this email ID and again switcher. So this is the email ID which we have sambal next and my password was I hope it is right. Yeah, so when you log in for the first time it would ask you to enter the current password. And then you can enter the new password. Let's say and then you re-enter the password. There you go. And you sign in so what happens is you enter into this portal as a fresh user. See, I'm a completely new user and it says do you want to start a tour but I don't want to do that. So I would just say maybe later. There you go. You have your fresh dashboard. There is nothing pinned here and everything is completely new. So, yep, you've entered in as a completely new user. And this is the active directory where I'm assigned to that is my previous active directory as you can see. This is what we have here to offer. So yes as a user I have certain Privileges and I can have access to this so-called portal. So this is something I wanted you all to see the the quite a few other things which we are going to go ahead and take a look at it. But for now, let me just log out and close this tab. I'm back here the other things I want you to understand and those things are if I come here what you can see is we have certain users here right there. Go if you take a look at certain email IDs, you can see these email IDs not these are quite huge email IDs, right? What happens is when you do go ahead and register your domain service you register that domain service with Microsoft Azure account. And when you do go ahead and create users you would not want to have such use names that are say, for example, we shall act Microsoft something something something something that can be long, right and that is complicated to handle or manage. So instead what you can do is you can provide them with sudo identities. Disorder ID is as well. So that the process becomes easier or simpler to handle. Let's try to do that and see how can we do that? Can we just go ahead and assign a particular domain name or a domain service when we just go ahead and create a new user or all those things. So in order to add a particular domain what you have to do is you have to go ahead and again, where is my active directory? Here it is and I just kind of scroll down you can see custom domain names where you can actually go ahead and add domain names but there are certain catches to it. Let's try to Stan those now it would ask me to enter a custom domain name and I say demo domain maybe yeah and let me give it some extension now again, let me tell you that this is a demo practice and it won't take in this particular domain name. I'll tell you why but first let's just try to add this domain. Yeah, the domain name is added but as you can see to use demo domain dot at with Azari create a new text record with your domain name registrar using the info. No, so if I say text, I need to copy this part and I have to actually go ahead and add this to my particular domain name. Now. I won't be going ahead and doing that because that is something that we are not discussing here because for that we would be needing some other domain name, which I don't have right now with me. So if you do go ahead and try to add a particular domain name, you need to have that particular domain that is suppose. I'm using a particular website or I have a particular organization, which has a particular website or a domain name. That is XYZ at xyz.com or something like that. That so I need to make sure that I go ahead and register or have access to that particular domain and then I need to go ahead and attach this particular text to it or authorized this text with it so that I can actually go ahead and confirm with Microsoft Azure that yes. I have an access to that particular domain and only then can I go ahead and use this particular domain with my Microsoft Azure if I click here on verify it would give me an error that I'm very sure of C could not find the DNS record for this domain DNS changes may take up to 72 hours. To propagate that means I have 72 hours to go ahead and add this particular text message to that domain and so that I can verify that yes, this domain is legal. But in this case it isn't I just took something for the demo purpose or for the reference a and this is the domain that I might have or which I can actually go ahead and use so yeah, this is how you actually go ahead and add a particular domain and you can actually go ahead and create a user as well. What you have to do is when you do go ahead and register this particular domain you can just go ahead and follow the processes like creating a user. Which we did in the previous case because that was the register domain when I use that so called Erica Dottie Kate was registered with my so-called as your account and I could actually go ahead and register that particular user. But in this case I cannot but yes, if you do go ahead and create a particular domain or you want to go ahead and create a particular domain or register a particular domain make sure that it is valid and it is underused and you can actually go ahead and register that particular domain by using this particular process. So yeah, this is how you actually go out and do all these things now when you have this particular Which is not registered and if you do go ahead and create a particular user on it. What happens is your Microsoft Azure would let you create that user but the credentials are the access that user has is as a guest user because your Microsoft isn't sure that this domain which you just created is actually registered or something that you can actually go ahead and use so that is one point which you need to consider now, let me just quickly go back to Mac to directory and see if there are any thing or any points that I need to discuss with you or something that we have messed up one. So what I'm going to do is I'm going to talk about something else called as creating an active directory or can we create multiple active directories? That is a question. If you ask me I would say yes, definitely you can create multiple directories. Now as you see here if I go to a particular directory, I would be having an option called as switch directories. Now if I click here I have certain options from which I can pick a default directory now in my case. I have quite a few directories which I can actually go ahead and choose from but I want to give you all a demo as an how do you go ahead and create one because these are something that we have created for the practice purpose or certain usage purpose. So let's go ahead and create a fresh one. So, how do we do that? Can we just go ahead and create one? Yes. Definitely we can create one. If you just scroll down you have certain options here. We had an option of creating a new directory. Let me just go ahead and see where that option is CS this option create a directory. So let's start by giving it certain name. Say Eureka one, two, three four. Not one two, three four, let's call it. Say idiotic. Idea Rica. Maybe is it the yep, and what should be the domain name? We did a car one-to-one and Eureka one-to-one State. Well, since I'm from India that stick to India and I say create it might take a couple of minutes when you just go ahead and create this so-called directory. So, yep. Meanwhile you bear with me and there you go. You have your directory here. You can just click on this thing to manage our Is as you can see it's a completely new directory which is fresh and new to use. That means as you can see it said Eureka Eureka and if we click on any one of these things you won't be having anything else now in my previous active directory. I had so many users if you come here you would see that as just one user main admin. I'd not have anything else or no other user whatsoever. That means this is a fresh directory because you can see if you just go back to the editor academic option you'd be having an option of Setting your so-called directory and you can do that as well. But I do not want to do that for now. I can just click on this and I go back see he has the option you can click on it and you can switch the user. So yeah, you can use multiple directories and you can have multiple uses for these directories as well. Now I can just go ahead and create users for this directory as well. But I won't be doing that now since I do not need this directory. I'm just going to go ahead and delete it. So I click on this icon. I'd not have permissions probably so I click on it and I ensure that permission. I entered I say yes, and I save changes it might take half a minute to update these properties or if the Internet is slow. It might take a long as well there. You see the changes have been updated if I refresh this thing. The access is given to me I can just I don't want to delete the dashboard. I just want to go ahead and delete my so-called active directory. So I do not have an access to my domain Services because of which I'm not able to delete this account. But yeah, you normally have an option where you can actually go ahead and delete this directory. So, yep, you can go ahead and do that as well. So this was the demo about active directory as in how do you go ahead and create a user? How do you create a particular domain space or Plumbing Service? Basically, how do you go ahead and create multiple active directories? We want to know about what is devops. These services available in Azure to handle the devops. So let's first learn about what is devops. Alright. So first thing is when we say what is devops. So basically just for the definition perspective. It's a set of practices intended to reduce the time between committing a change. So let's say you are building an application. If you commit a change committing this change and taking it to the production is a very long process, but then devops means that once you commit a change and finally taking that change to the production. Devops is something which can help you reduce the overall time and provide your standard set of practices using which it makes your deployment very very smooth. Of course, it can help you maintain high quality in your application. This means if you want to do testing if you want to do some reviews all these things basically are covered in the develops. Some of you guys might be coming from the development background some of you might be coming from the operations background. So this is a place where both of us meet together the developer The operations guys, they come together and work together so far in our normal work environments, if we are not into devops, what do we do? The developers have the responsibility of you know, doing some coding building that and finally putting it into a source control once you put into a source control the test team will actually take that source code do their own builds and start doing the testing on top of it. Now once they are doing this testing they will do some tests of push it back to the development team and this to and fro keeps happening. Once all this testing is complete then you put everything into the operations bucket. Then you tell them that yes, we are done. We have completed everything. Now you go ahead and make a release of it do the deployment to the operations on top of it. Keep monitoring the stuff if you face any challenges then inform the developing T. Now. This used to be a very siloed approach so developers and testers working separately. The operations guys are working separately and there is news to be a lot of friction between these two areas. So now when we come Devops environment these two set of people. They have actually become one which means you together do the development you together put it into the source control you do the testing and finally you go ahead because it's not just individual people. It's a team so you go ahead and do the release you do the deployment and finally do the monitoring so that you know, because if you have started developing something, you know that what is the best thing you have developed and how you need to handle that. So this is one area where the developers and operators Nations they come together and work as a team friction can be reduced to the time to Market becomes faster and the quality even becomes much better. Do not worry. If you do not get the hundred percent of what is happening. But then the overall idea to understand is that now the developers and the operations they come together and work together as one single team just for this, you know, a very small diagram the developers they will build something they'll start pushing it to the operations team. So you do the deployment you take care of everything the operations if they will face. The challenges they'll start pushing it back to the developers team looking at a very small thing. Okay, if I can solve something very quickly. That's fine. Otherwise, I'll start pushing it back to the developer team saying that this is not working. So there is lot of friction and there is lot of miscommunication that happens in this kind of environment way to solve it is that both of us the developers and the operations work together as a team. OK. I hope you got some glimpse of what is devops. And now we'll going to talk about some tools which are available in devops when we say divorce. Oops, each of these areas are covered by different kinds of tools. So if you are doing some development, you might use let's say Eclipse, you might use let's say a visual studio, you might use Visual Studio code and then you are checking in your code and TFS team Foundation Services. You might be checking in your code in jira and get a lot of different repositories. Now, this is one area. Of course, if you have to do some builds, you can use a kudu server. You can use Maven you can use Gradle. So all these different tools are used to Build your applications. Finally if you are done building your code. And if you have done all the check-ins, then the testing happens, you might be using selenium you might be using selenium or J units to do the testing of your applications. Now again, you can see here all these different areas require different kinds of tools. And if you are releasing something then of course you can use Jenkins and bamboo to release your stuff. Finally you do the deployment. All right, so there are different tools to do the deployment and then you do the operations. Which means Has your operations team is sitting there and doing all these operations stuff and they are monitoring this stuff using different tools. When we say that we want to build a devops platform. We want all these tools what you see here to work together so that you can do this activity without having to do any manual intervention. Okay, and this is where we are going to spend our time into looking at how these tools can be used when we go to Azure devops. I guess you guys have learned about what is your some basic stuff? And what is devops now? We are going to look into if I have to do all this develops activity in assure. Okay. So what is it that is available to us. And now let's learn about what is as your develops. So as you develop something which is providing us all these set of tools integrated into one single environment. This means that if you don't know how to work with the clips, if you know how to work with TFS if you know how to work with get selenium all these different tools then you can Use as your devops or in fact in my case as well. I didn't do you know lot of tools but still when I started learning about SEO develops, I started learning about all these things as well. So you don't have to worry that if you are not a part of any of these particular areas, for example, if you're not part of right now how to do the deployment or if you're not part of how to do monitoring and you are on the developer site or basically you are into the development side, then you don't have to worry that will I be able to use Dev Ops or not. So the answer to that It is. Yes, you will be able to use the dev Ops or in fact that will help you move towards the devops, even if you know, maybe a couple of parts of it. So now we are going to talk about what are different components of azure devops and ones will see some demos you will be very clearly able to understand how you can take your application from the planning stage up to the deployment and monitoring stage using the tools in ashore. Okay. So let's learn about what are different components of has your devops which are available now, let me just Just show you all five actually. So there are five different components which are available as part of azure devops. First thing that we need to know is about as your boats. There are people who come from the scrum background. They are coming from the project management background. They know how to create some features. They know how to create epics. They know how to create the stories. They know how to create tasks and all that stuff and then there are developers who themselves go and create the task on which they are going to work and there are red. Or soon just want to create some test cases and after the test cases are done. They want to create the bugs which they find in the system. Now all these activities can be done as part of the Azure boats. Number two is of course after you have done all the planning after you have created all the epics all the features all the stories task and everything. Second thing you want to do is develop it. For example, you start doing development in TFS you start doing development in Eclipse any ID that you want to use you can do the repent once you are done with the development. Now you want to push all this into a source control. Now, this is where as your Repose will come in and it will help you store all the information. So in the source control you check in your code. And as your Repose is a place which provides us with lot of different repositories. In fact right now it's too if you want to use team Foundation services or if you want to use get so basically you can provision that in Azure Repose and you can start checking your crap location code in azure. Looks so again. We are going to see all these things in action today. The third thing is once you have checked in your code. What do you want to do next? So there are two things that you want to do. First thing is that you want to run something called as a build pipeline when you have checking your code you want to make sure that nobody has checked in some wrong code. So this is where you build your code. Of course, the developers have the responsibility to build the code on their local machines. This is not a good practice. Now if developers is just building it on there. Our local machine this means that maybe some of the dependencies on that machine are not correct, or maybe it's not in sync with the other team members. So this means that if person says that yes, it is building on my machine and I just want to push it in the source control is that good? The answer is no because this means that if somebody will have it special dependency in the application, which is installed locally, but it's not installed, you know for everyone for others when they will download that code it will fail so that is why whenever the Developers Something in the Repose or basically in the source control it is going to be taken by the issuer pipeline. It is going to do something called as a built. Okay. So the building of code happens in the Azure pipeline. Now next thing is the build has already happened. What do we need to do? Next? The next thing we need to do is release this code now, I can release it in the dev environment. I can release it in let's say a pre prod or you at environment or I can also release the stuff in production environment, but Ali what do you do if developers check-in something we do the build of the code and then we release it in the dev environment now once it goes to the dev environment or maybe in a test environment it is going to run after it run completes. Then you would want to run some kind of, you know, some tests on top of it. Let's say you have deployed a web service. So if you have deployed a web service, you would want to test if it's behaving correctly or if let's say you have deployed a web application. You want to check if everything is looking fine in that web app or not, so Are you can run manual test cases automatic test cases? You can even do the exploratory testing all that stuff can be done as part of the assure test plans. All right, and finally once all this test pans is done we can again use basically the pipelines to release something to different environments like you at production and all that stuff while all these things are going on. There are a lot of things you can configure like workflows or in fact, let's say approval workflow. So if you are checking in something you want to Make sure the review happens so that can be taken care in the as your Repose. If you are leasing something to the you at environment you need let's say an approval from your team lead or you need an approval from the program manager. So all these approvals are by default built in into all these Services now one thing which I haven't touched upon is as your artifacts. Now, this is something for example, let's say you have got ten projects and all these ten projects have got common dependencies. It may not be common in all but let's say three. Ticks are using one dependency five projects are using some other dependency. So what you can do you can collect all these dependencies and put it into a one single location called as your artifacts. So I'm going to show you few of these things in demo today that how you can use as your boats as your Repose as your pipelines. And of course, I'm not going to touch in the demo on test plans and artifacts now, I hope everybody understood this overall infrastructure. We have got as your boats to create our work items we have got Has your repose to store our code we have got as your pipelines which can help us do the build of the code. Please of the code into a particular environment. Then we have got SEO test plans, which we can use to do our testing which could be a manual test cases automated test cases exploratory. Testing all that can be done as part of the Azure test plans. And finally if you have got some common dlls or common jar files, which you want to store it as part of your repository, then you can use as your artifacts now. Look at some of the more things now first thing as I said is as your boards, so we have got five different components as part of as your boards. Alright, so as I said earlier as your bolts is a service for managing the work of your software project, which means you want to create some let's say epics you want to create some features basically some tasks some product backlog items. You want to create some bugs all this can be handled in as your boots so you can set up that I want to follow the a child process. I want to Follow the scrum process. I want to use the conversion. So all these things are available as part of the Azure boots. So it does not matter that what kind of process you want to follow. I know that a lot of people know about agile. So guys, I am also an agile and save certified so I know there are different processes and all these different processes can actually being handled by as your boats. So what you can do you can go ahead and create a work items. Then you can have the backlogs now. I'm going to tell you what is a work item. There's a backlog and then we have as your boats. In fact board is something very basically you can run some queries and see that what is something in particular Sprint or let's say what are the tasks which are active or what are the tasks which are closed if you just want to say that whatever the task which were released in this particular Sprint. So all this information you can get it from the board's next thing is about Sprints. Now, let's say a Sprint is of 15 days. So in 15 days what other work that we are going Going to accomplish. So those things are basically those tasks or features. They go into Sprints. All right, and finally, we have the dashboards which can help you have the overall picture of what is the progress of your particular Sprint or what is the overall progress of a particular release? Okay. So this is what is covered as part of the Azure boards. We can just talk slightly more on this and then we'll see that in the demo. Now. What do we see here? We have got work items pretty simple stuff. Let's say you can see here. This is a bug being created. This is a user story which is created or basically the backlog item which is created. Then we have the tasks which are getting created and the same way we have got features. We have got epics which we can create as part of the work items. Then we have got boats so you can see that what is basically the particular fro of your current Sprint or what is the flow of your project? Of course, we have got backlogs now we can arrange what do we want to do as part of the backlog? How do you want to prioritize your different work item? So you can deliver your software on time? Next thing is about Sprint's if you guys have not worked with Sprint, so do not worry because we don't want to go into that whatever details of Sprint's but then Sprint is basically let's say a small time boxed window in which you can go ahead and deliver a particular part of your product in your e-commerce application. If you say that we want to deliver the check out functionality. So let's say if you are ready to deliver the check out functionality Not two weeks as part of the Sprint so your checkout feature or your checkout epic will go inside that particular Sprint. So once it goes in tide that particular Sprint the whole team starts working towards that particular area and what they do they try to complete all that stuff during that 15 daytime box window and that is what you can build as part of the Sprints. All right. So then we have the final dashboards where you can see. What is the current status of your project before we go further and look into Other different aspects like pipelines and stuff. I just want to give you a small demo of how you can create the work items how you can create the backlog items and how you can use the boats. So let me stop here for a while. Okay, and what I'm going to do now is going to go to something called as Dev dot as your.com. What you need to do here is if you are not signed in till ask you to sign up or sign in and once you sign in this is the kind of basically the dashboard you will see what you can do here. First thing you can do here is create a new project. Alright, so let me create one. What do you see here? It is asking me that. Is it a private project or is it a public project? Now, let's say if I want to create a project called my test project for and not going to create it it takes some time, you know to set up everything but what I can show you here is that now it is asking that what is the Version Control? So basically, where do you want to keep your source code? You want to keep it in get or do you want to keep it in TFS? Okay, so you Go ahead and select the different version control options which are available. Now, of course, I think with time they will keep adding more and more, you know Source controls of the Version Control repository is here which you can use but most common ones which we everybody knows is get we also have GitHub which is again a repository for storing the gig base Version Control. Of course, there is something from Microsoft which is available, which is the team Foundation if some of you guys have worked before with the fs or the team Foundation services, this is the one it is Totally up to you. How do you want to store your code? So I'm going to select get right now. The next thing is about work item process. So if you want to follow the agile process, you can use this one. If you want to use a scrum process, you can follow this one then of course, you have got cmmi and a basic one now basically something which does not follow a particular process, but this is something which can help you set up either the agile process or the scrum process. It's like a kind of a blank template, but if you are comfortable working With agile environment, you can select this one and you can click on create now as soon as you do that what you will see is something like this one my test project three because I created this one and I added few things here. So I want to show you that. All right, before we go into inside this particular my test project 3, what are the things you can see here? Something called as as your boards, which we have already talked about the repositories as your Repose. Then we have the assured pipelines. We have got the test plan. It's and then we have got the artifacts the same stuff that we have seen in the slide. It's available on devadatta co.com. Once you create a project now, let me go ahead and first of all click on this project what I have done in as part of this project. I am using agile. Plus I am using get so I've selected this one and this is now showing up in my test project three. The first thing as I told you that I want to show you about is boards now, let me go here on the left hand side. You can see boats. A proposed pipelines test plans and artifacts. So I'm going to go inside boards right now and straightaway show you what you can do in the boats. First thing is of course pretty simple if you want to do the planning. So what do you do you create something called as a let's say a task or basically you create a work item now work items are of different types. You can have something called as an epic. Now epic is something which is very very high level. So let's say your leadership team comes up and they Define Thing called as an epic. Now, they will say that we want to deliver this kind of project. All right, so there they are defining a particular epic now inside the Epic what you can do your product owners or let's say your project managers. They will go ahead and decide on the number of features that you want to have as part of the Epic. Let's say you want to build an e-commerce site. So in e-commerce site the business says that we want to set up some eCommerce set up for our this business that's in Epic once you go inside that Epic. You will say that I want to create a feature now. What is the feature here? I want to deliver the card functionality. I want to deliver the product page. I want to have a recommendation engine or maybe I want to have a search engine in my e-commerce portal. Now. This is what will be created by product owners or they will be created by the project managers. Now when you say I want to create let's say n search service in my e-commerce site. So as part of the search service, what do you need? You will go ahead and create some stories. So in the story, what will See, you will say that I want to have some database ready which will contain all the information of my products. Then I am going to have let's say one more story for building up a middle layer, which can help me, you know some building some apis which can help fetch this information from my database and show it to the end users. Then I will build another story to say that I want to show it to the end customers. And once you have these user stories, then you go ahead and create tasks inside that particular story. So let me start building up. Let's say one feature. I'm not going to you know, go into the complete agile model. But right now I'm just saying that we want to create a feature for let's say search in e-commerce. Okay, just remember guys. This is not the way we write in a child format. So if you want to, you know, just create a new feature. There is a particular format in which you should create the feature. Basically the text has to be in a particular format, but that's not the agenda for today. The agenda is to show you that you can create a new feature. You can provide a particular iteration path this I want to do it in this particular time frame. Okay, I can create multiple iterations. Okay, and I can put up the I thracian here now next thing what I can do here. I can link it to some existing item. All right, so we'll do it later. But then we'll say what is the business value of this? What is the time criticality? What is the start date? What is the target date which we want to complete this particular feature. This feature is new right now. So let me save it you can go ahead and provide description. You can use the discussion board to do some discussion on top of this particular feature. And once you are final that yes our Future details are ready then what is the next thing? Let me go back to work items and let's say I want to create a particular user story. What will I do? I will say that I want to create let's say in the search. I want to create the apis. And what do I need to do? I need to link it to the Epic or in fact, I'll need to link it to the feature on the right side add link existing item and I can also say that what is the parent here? So the parent is We searched for it. So the parent is search in e-commerce. Okay, so I'm going to link in this one and say that I am creating a user story. Let me save it. In fact, you can see that if you know about what a story pointing so you can add story points here or in fact, let me tell you this if you go for you know for any kind of course or not just from here, but if you go for any kind, of course about how do you handle a child? So there you will learn more about story pointing so you can also provide the risk. Let's say this is a medium risk. What is the priority here? All this kinds of setup. You can provide here that are you want to do some architectural thing or you want to is it a business feature? All this information is provided as part of the user story. So let me save this one. Go back to the work items. So right now this is showing is separately but once will go to the boards. Let me go to the backlogs first what you will see here all the different stories which are available. Now. This is something on which we want to work. Let me add one more story here new work item and let's say UI for search. Okay, let me add this one. Now. What you see here is we have created now to stories in the first print or basically in the planning side. let me just open it up and So as part of the eye tration what we are going to do in the first iteration or let's say in the first 15 days what we are going to deliver. We are going to deliver API for such service. Or in fact actually both of them have got into the same iteration. So now you can see here. We have got one story which we are going to cover in iteration 1 which is right. Now the current one and one story we are going to cover as part of the second iteration. Now, in fact, if you go ahead and add more tasks to it. Let's say if I click on I can even change the priority for this one by dragging and dropping now click on API for set service. I can go ahead and click on or in fact, I can see the whole history of that particular. Feature or in fact that particular user story I can also go to this particular link and I can say that I want to add some child items here. Okay, so I can say add a new item and that is a child item which is of type tasks and then I can say that I need to do some basic setup or maybe let's say some design of my service. So that is one task. I'm creating. All right. So what is the original estimate for creating this particular task? I can say 10. Ours what? Is the remaining time Tenors completed 0 and I will provide some description here and save it. So this means if I close this one, and in fact, I'll just refresh this page. You will get a complete idea of what are the tasks which are or what are the stories on which you are going to work on or basically, what are the backlog items on which you are working in and what are the tasks under that? So this is the kind of thing that you can set up with Azure develops. I hope this stuff is clear to you guys. So we have got different titrations. Let me click on Sprints so you can see right. Now. The first citation is going on and the design is here once I start working on this. I can even use the visual Editor to make it active. Once this stuff is done. I can even move it to the result state. Okay, let me just open this one. I can just close this task. And say that's it. So this is how my overall flow of basically the work items work. Now next thing which I want to show you is repositories repositories. We mentioned that we can use either get or we can use TFS to basically maintain our source code. I'm just going to show you a demo right now to show you how all this stuff works. So what you will do here you can set up a repository which is like a get or a TFS. Then you can go ahead and start checking in your code. What? First thing you will see here is because we are using get so I'm clicking on something called as branches and in the branches there is a default branch, which is always available. Now that's called as a master branch. In fact, you can go ahead and create more branches in some of the source controls like TFS you will have one single place where everybody's checking in the code now in case of get it does not work the same way. It's a very different structure. So what you do is you create your own Branch you work in that branch, which means This branch is basically a copy of a master Branch. So you will go inside that Branch you will make your check-ins now that is your branch in which you are making the changes. You will do the testing. Once you are completely fine that everything is running fine. Then you are going to push those changes from your branch to the master Branch. Remember that if you haven't worked with get before so there is nothing to worry about because this is not something specific to Azure devops what I am talking right now about the branches. This is something specific to the Get so let me show this thing that we have right now a default Master Branch if I'll click on this one what you will see I have already check in one particular project into my repository. Okay, that's called as a web application to if I click on this one. It's a very simple MVC application that I have created and added it into the source control. I'll go to the visual studio. Now in the visual studio, you can again see that I am using git tools for visual studio. And this is showing me that I have got a master Branch. Now what I can do I will let me create one more application and check that in. So let me create a simple application file new project asp.net core web application drawn. Remember remember you can use Eclipse you can use IntelliJ or And use any other ID to do the development. Okay. So this is not restricted to dotnet or Visual Studio. You can do use any kind of platform or any framework to build your application or it can be in any ID Eclipse IntelliJ. Anything will work here. All right. So what I'm going to do is create a new application called Web application 3. Let just application being created. All right. Now that we have created our application. What do we need to do? You can see here that my project is ready. I am going to Simply push this code into the source control. Okay. How do I do this? Let me first of all. ignore few of these items and what I'm going to do is Okay, I'm going to Stage these items now this something very specific to get so if you are not comfortable with gig do not worry because this is something you can learn very quickly. All right. So what do I have here? I have got my full application, which is web application 3. I can go ahead and check in into a git repository which is managed by as your devops. So I'm going to say Checking in web application three. Okay. Also, I can actually go ahead and map it to a work item. Let me click on this one and go back to portal to my work item. In fact, we do not have a work item for development. Let's create one. So UI for search service. Let's go back to the links. I hope you guys remember now. You can click on ADD Link new item and let's say we call it build web app 3 Okay, let's call it create. I know this is not the way we write the task. But just to give you an idea that I am just creating a new task called create web app 3 that's it. So it is going to give me create web three tasks is ready. I can click on this one. And the task number is 10. Okay, so I'm going to copy this one go back to visual studio enter the ID of the work item. Okay, so I'm going to say 10 is the ID. And you can see basically the related work item. Now what we are doing here. We are creating a new application when we are checking in the code. We are also specifying. What is the related work item? All right. So let me commit all the stuff in the code sink it back to the cloud, which means now I have checked in into my local environment. I just want to push these changes into the cloud environment. So again, this is specific to get you do not have to worry about this. Just give me a second. I'm just something related to you know, get I need to. Okay, so I think they should work now. We push these changes. Okay. So now this is going to push my changes to the source control. All right, so you can see here. It has been successfully pushed to the master Branch. If I go back to the devops environment what you will see here. In fact if I just open up the application as well so you can see here. This is the parent side and fact, let me just refresh this one. Okay. So what do you see here in the description or basically in my history? I can see that I have done some checking here. So it is linked to that particular check in. Now you can start visualizing this stuff. So you have got tasks you have made your check-ins from those chickens. It is coming in once you make a check-in and attach it to a particular work item. It will be linked to that particular work item. So if anybody is going and looking into what changes you have made as part of this task, you can actually go ahead and see all that stuff now, this is a part of Dusk next thing is let's go back to the proposed and see the Comets. Okay, we have made a commit into the repository. What do we see here? We have got check-in web app three. Okay. So this is what we have checked in as part of the web application three that we just created. Now. The next thing is I want to build this application. Okay. So if you guys remember the second thing was checking in the source code after checking in the source code. I want to automatically build this particular code, so What do I need to do here? I need to go to the third component called pipelines. I see something called as belts which means I want to take up this particular source code and do an automatic build of that. So what I can do I can click on something called as new build pipeline have already got to create it, but I just want to show you from scratch how this is done. So where is your coat? It is asking me so my code is present in a git repository. So I'm going to select this one. And what is asking me that? Where is your Source? Okay, or where is your git repository? Alright, so my repository is in as your Repose get okay, so I'm going to select this one. You can even select GitHub. For example, if you just want to pick up the code from GitHub directly and use it you can do it here or you have the GitHub Enterprise server. If you have got GitHub deployed in your local environment or in your Enterprise environment, you can use subversion or you can in fact if you have got TFS there's a different way to use it. But then right now we are Focusing on using the get in as your Repose. Alright, so here you can see it. I have got my test project 3 which is my basically my repository and my team project then I am going to pick up all the code from Master Branch. Okay, so I'm going to click on continue. And the first thing that I need to do is tell Azure how to build my project. So how do I want to build my project? I want to build this project as part of as your web app. This means I want to take my Code and finally, I want to deploy it in a service in Azure called as your web app when we say as your web app, then I want to build my project as part of the as your web app. Okay. So if you want to a do a normal build, for example of your asp.net application you can do it. If you have a gotten Android project you want to build it if you have got Maven, let's say you have a Java project and you want to use Maven to build your projects. You can do it. You have got python packages. You have got SP dotnet core then. Have got if you have know what is a container. If you want to build Docker containers, you can do it from here. If you want to deploy basically build and deploy for as your community services. You can do it. Then if you have got just a function you can build a c-sharp function you have the as your web app for Java. So all these things can be done as part of the Azure build pipelines. Okay. So what I'm going to do right now is select a service in Azure. Basically, I want to deploy in this particular service called as your web app. Oops, and that is why I'm going to select this one to build my code. Now if I have to build my code, what do I need to provide? I need to provide where is my solution? All right. So I'm going to click on this one and tell the system or basically tell my build pipeline that it resides in web application three. Okay. This is my new project that I picked up. I'm going to select this one and click on OK then finally provide. Where is this Azure subscription in which I want to deploy. So I'm going to select this is my subscription in Azure. And what is the name of the app service again? There are few things that we are rushing through. Okay. So this is what we can select and next thing is I can go ahead and select. So this is what we are going to do. We are going to build as part of the build pipeline. So we are going to take the source code from the git repository do a build of it automatically. Let me save this one. And cue it which means I'm going to save this Pipeline and start doing the build of my project. So now that we're are build pipeline is ready, which means you are code is going to be get built. Let me show you when the build is happening. What is going on? So it is does going to take some time to do the build because this is the first time it is happening. But I'm going to show you that I already have one pipeline which is already built for my web application to which was very similar. So while this is running let me go to builds. And this was a pipeline which was completed successfully. So let me select this pipeline. So this is how the build happens. So if you open up anything it is going to give you the detailed logs of how the build happened. So it picked up the code from your Source control it data built and you can see all the build activities which happened as part of this pipeline. So you can see here. It picked up the web application to project and it started doing the build. It did all the copied files to Output directory. And clean up and all that stuff and finally it did a build of my project now once I did a build of my project what next so you can see here it approximately took five minutes to do the belt. So what you can do as part of your as your devops as soon as somebody checks in the code, it will automatically trigger a build pipeline using which your application will be built. And if there is a failure then the person will be informed back using a male that your code is not correct. Okay, so you have to rectify the your code as soon as Chablis now once we have done all this build activity what next we need to do. We need to release it to a production environment, or maybe to a you at environment. How do we do that? We do it using something called as releases. So now that our this one is ready either. I can click on release and build up a new release pipeline. So let me click on this one. And I'll say I want to create a new release. So I'll click on release to and what you will see here now that the complete build which happened now it is asking me that where do you want to release it? So, I've already created a release pipeline. In fact we can let me click on this and let's create a new one as well releases new pipeline. And is asking me where do you want to do the deployment? So I'm telling a sure that I want to do the deployment in as your app Services, you can deploy a Java application. You can deploy a node.js application. You can install it in service fabric. You can install it, you know deploy a rails on Ruby application on app service. You can deploy an is website. All right. So all these things you can do. And I'm going to deploy in as your app service. Alright, so once I select this. I just need to provide what is the application basically which I want to build and what is the Azure subscription in which I want to deploy the application. Let me select this one. So there is one. I've already created my test app service. Once I've done this I can save it. So this is my release pipeline is ready. So now my code has gone into Source control my build pipeline which is picking up that source code and building it that is ready. Now. This is my release pipeline which is going to take that build code and going to do the deployment. Okay? So I can click on here and say create a release and that's it. Or in fact one more thing. I can show you if I go back to the main pipeline. I can even set up who will approve it before it goes into a particular environment so I can click for example pre-deployment conditions. And say who is going to do the pre deployment approval if your team Lee needs to approve the overall release before it goes into you at or production, then you can specify who is the approval. So in this case, I'm going to put in my name. All right, and I'm going to save this one. So this means as soon as the deployment will start happening it is going to ask me for the approval. I will get an email that please approve that release deployment then only it can go to production. So I'm going to click on now create a release and click on create so go to the release which has been created now and you can see it is saying pending approval. What I can do is because right now I am the owner so I can click on approve and say Yes, I want. to basically approve this particular release And then it will continue further to do the deployment. Now you can see here the approval is done. And right now this is under queue, which means as soon as the resources are available in Azure, it is going to start the release deployment. And while this is right now, it's in a queue State I can show you the one which I deployed for web application to so I will go back to the releases. Okay, so this one is already done. But not this one. Just give me a second. Okay, so this one is already done. So what you will see here after basically, everything is done or basically the release starts and it starts deploying you can see the logs here. If there is a failure in your pipeline it is going to you know inform you that there is a failure in the release that you will get email so you can quickly act on that. Otherwise, it will download all your build artifacts in our case. It was a web application. So it downloaded all the artifacts of my web application and then it is starting. Deploying it to the Azure app service. Okay, so you can see all the logs. In fact, you can even write custom logs here that this is what we are doing as part of the release deployment on Azure app service. Alright, so you can see here successfully updated the deployment History app service application is running at this particular URL and then you can use this URL now once this release completes which means our code which we created has been deployed into production. Let me go back to a show or now. Okay, and I'm Right now into Azure portal which you can get from Portal not as your.com. You can click on my test app service which we are using for deployment. And if I run this particular app service, which is basically a platform for hosting the websites or in fact platform for hosting different websites. API is mobile applications so I can click here and see my application is successfully deployed. So just to summarize all this stuff now you can see here the application is ready. There are five components basically. Of the as your develops, which means that we have got as your boats in which you can manage your work items. You can manage the tasks. You can create either a scrum boards Convent boards, or you can have the a child process all this is being handled as part of the as your boots now. Second thing is about as your Repose where we have got get NTFS in which you can check in your code and you can manage all the branches you can manage complete get functionality which is available as part of the issue reports so you can check in your source code there. R the third thing is about as your pipelines in which after you have done the check-ins, you can build your solution and you can also release Your solution in multiple environments like Dev pre prod you at production all that stuff. Next thing is about as your test plans which we haven't covered. I just wanted to give you an idea of what other test plan so test plan is something where you can run your automated manual exploratory testing under as your test plans and finally you have the Azure artifacts. Which you can store some dependencies. So this is the overall picture of azure devops. Today's topic of discussion is as our data Factory, which is very important from data integration and data management perspective. But before we do go ahead and dive into the concepts of this particular term, let's quickly start by taking a look at today's agenda first. I would start things off by talking about why do we need a user data Factory and what it is exactly then I would talk about various Concepts that surround this particular term would also understand something called as data lay not in to death but to some extent and would also understand various. Steps that surround this term as well. I would discuss two other terms that is data like and data warehouse. And what is the difference between these two terms? And finally, I would finish things off with a demo part as far as this demo goes. I would be talking about creating a pipeline and moving data from one source to the atom. But that is for the later part. Let's start with the first topic of discussion that is azure data Factory. So why do we need a user data Factory? Well first and foremost we need to understand the fact that the amount of data that is being generated. These days is huge and this data comes from different sources. Now when we move this particular data to Cloud, there are quite a few things that needs to be taken care of now this data it can come in any form because we are talking about different sources and these different sources would be Fedor channelized this data in different ways and it can be in different formats. So when you do decide to bring this data on cloud or at a particular storage place you need to make sure that this data is well and truly managed. Now. What do I mean by this? Well, you need to transform this data, you need to delete unnecessary part or get rid of all the things that is not needed now, that is an after party or pre-processing part. But as far as moving this data is concerned you need to make sure that you pick this data from different sources and bring it at one comment. Place then store it and if required you should be able to transform it into something more meaningful. Now. This is something that can be done by using traditional data warehouse as well. But then there are certain disadvantages. What happens is at times you're forced to go ahead and have custom applications that deal with all these processes individually and this can be time consuming and integrating all these sources can be a huge pain. Now, how do we solve this problem? Well, if there was a way to automate this process or create For workflows. This burden would have been taken care of. Now. This is where data Factory steps--and what it does is it kind of helps you automate this complete process instead of seeing automate. I would say it helps you orchestrate this process into more manageable or organizational manner now that is something that is needed. And that is why we need something called as data Factory which lets you automate all these processes. Let us move further and try to understand exactly what data Factory is. So if I just go ahead and talk about its definition I would say it is nothing but a cloud-based integration service, which lets you do quite a few operations, like create data-driven workflows basically and to go ahead and orchestrate all the sources that are there. But what exactly does it do to name few common operations what it does is it helps you create pipelines which are nothing but you can think of it as a logical pipeline which supports various. Does that happen it lets you ingest data from different sources and then process it when we are talking about processing it. It also helps you go ahead and do analytics which is very important these days because we know that the amount of data that is being generated. It can be helpful and it can help you take various good business decisions. And this is where analytics comes into picture. Now what data Factory does is it lets you transform this data and make it ready for something like data Lake to use it now data like is something that lets you use various analytical tools or methods. Words like you have something called as a juror hdinsight maybe a Hadoop Spar other data like analytics and all these things. Now as we move further, I would be talking about these terms to some extent but till then you'll have to wait for now just understand one thing that these are nothing but platforms or tools which basically let you go ahead and do various analytical operations. So that is what data Factory lets you do it lets you get in all the data arrange it in a particular manner or order and then supplied further for various processing or various other things that can be done with the data. So if Talk about particular steps. What does it do? Exactly? Well first and foremost what it does is it helps you collect and connect data. Now when I say connect I'm talking about connecting to various sources from which the data can come now, there are quite a few desperate sources from which the data can come you can connect to all these Resources by using your data Factory. And then once you have this data, you can collect it and store it at a central place. Say for example, your data warehouse, then comes the process of transforming and enriching it now when I say transforming it, I mean running various patterns on it creating schemas and all those things we can then actually go ahead and publish this data. Now, we all know that Microsoft Azure supports various other tools as well. We have one more popular data visualization tool called as power bi which is very good. When you talk about data integration and various data visualization capabilities, what you can do is you can connect power bi to your Microsoft Azure and publish this data that is create various dashboards and all those things now that can be very insightful when you talk about it from business intelligence perspective. So, yes, you can go ahead and do that as well and then you can actually go ahead and monitor your data that means You can take a look at all the data that you have and you can actually go ahead and analyze it in real time as well. So these are the processes which we are talking about that is connect and collected data transform and enrich it publish it and monitor it now that is what a data Factory lets you do. So what are the concepts that surround this particular term? So when we talk about data Factory Concepts, we have quite a few terms to discuss like we have pipelines datasets activities and linked Services. Let us try to understand these one by one first we would be talking about pipeline now pipeline is nothing but think of it as a proper pipeline that is it is something which acts as a carrier in which we have various processes taking place. Now, this individual process is nothing but an activity if you take a look at this Understand that activities represent processing step in a pipeline. That means your pipeline can have one or multiple activities. Now when you talk about this activity, it can be anything. It can be a single process like wearing a particular data set or it can be something like moving data from one source to the other. Then you have something called as data sets now data sets are nothing but sources of data say for example, my data is stored at an end location and that in location is nothing but my data set so in simple words if there's nothing but a data structure that holds my data link Services now, this is nothing but a law say, for example, I need to move my data from a particular database to a blob storage. They need to be something that connects these two things that is a law or some information that lets a database understand that it has to move the data to a particular data source. So that is what a link service is. It is nothing but an information that tells a data Factory that is you need to connect to these particular sources. So these are some of the Concepts that form a central part when you talk about a data Factory Now next we are going to talk about something called as data links. Now. This is something that we won't be seeing in the demo part but it is important when we talk about data warehousing and I feel that when I move further or I create more sessions or videos as far as this topic is concerned. I would be talking about analytics and quite a few other terms as well. So this is a particular term which is reserved for those sessions and videos. But for now, I would be giving you an overview of this topic as well because I feel that it is important when we talk about data warehousing. We need to understand what data lake is. First of all, let's start by understanding what it is exactly. Now think of it as a container or basically a storage that holds data. Yes. We already have databases. We have so many things. So, how is your other data like different? Well think of it as a hyperscale repository, which lets you do quite a few other things as I've already mentioned analytics is something that is very important. Now when we talk about huge amount of data the quite a few things which you can do with it, you can use various analytical tools. To name a few we have some here. We have our observed data like analytics. We have SD insights are spark and machine learning. Now. These are some of the commonly used and very popular tools which are there what other data like does as it supports all these tools? That means you can store data from any source and in any form at your other data leg and then you can use these tools and terms to actually analyze this data. So that is true in one kind of an operation. In fact, it is multiple in one kind of an option basically because it lets you do so many. the things so what are some of the concepts that one should know first? Let us try to understand some of the components when we talk about this particular term. That is your other data, like basically it forms of two parts one is your analytical part and the other one is just storage part when I talk about the storage part the best thing about your other data lake is it does not have any particular schema that means data from any form can be stored into this particular source. That is it can come from different sources and it can come in different forms as well. And then you have something called as your analytics part. That you have something like that SD inside it lets you form those Hadoop clusters. Now, I won't get into the details of what are the cluster is but it is a process or a way by which you can actually analyze data. So yes, you can actually go ahead and create those Hadoop clusters take that data in and then process it as well. You can also go ahead and use other data leak other data like analytics is something which is again used for various machine learning and other analytical process as well. So these are the two things which your analytics part will have and apart from that you have something called as a Purchase Park, which is nothing but a fast computation processing thing. That is something that lets you process data parallely and in huge amounts as well. So these are some of the basic concepts when we talk about your Azure data Lake and how does it actually go ahead and process the data? Well, let's see that as well but there are certain key points, which you need to understand that is when we talk about has your data. Like the first thing it does is it lets you store data in any size and of any kind which is very important because what this does is it kind of takes away the barrier where People had to wait to go ahead and process the data. They had to take this data first clean it arrange it organize it and then put it somewhere from where they could actually go ahead and use it. Now. This is something you do not have to worry about here. Why because you can just go ahead and dump your data in your data Lake and then actually take a particular schema pick the data and then start processing it. So it helps you save time and it lets you store data of any kind in any size. Now the second point is all users productive on day one. That is what I mean. That is since the data. A of any type can be stored here. You are not restricted. You can just start working on it from the very first day and it is ready for any kind of Enterprise. That means there is no restriction on what kind of tools do you want to use and what kind of business problems are you dealing with? So what are the types of data that your data leak stores first and foremost what it does is it stores structured data semi-structured data and unstructured data, that means all the types of data that can possibly be there. As far as touring is concerned. Everything is taken care of now when I talk about structure data I'm talking Our data that has a particular schema. Then you have something called as your semi-structured data. Now this is nothing but your Json files or maybe our XML data even that kind of data can be handled and when I'm talking about particular unstructured data that is data which can be in text files and has no schema or no pattern whatsoever. Even that kind of data can also be stored by your data link. Now, let us try to understand how does it actually store data. If you all know how Hadoop stores data this would be quite easy to understand now we We all know that what Hadoop does is it takes a data? It divides it into chunks and then processes it parallely. Now, this is what a data Lake also does say for example, you have a particular file which has some amount of data now as soon as the size of the data goes about 2GB it breaks this data into two chunks. Say for example, I have maybe 10 GB of data so it would break my data into five chunks of 2GB each and then it would replicate this data that means three copies of this data would be made and Would be stored at three different locations or at same location as per the values are rules. The user has set. So when you store this data and replicate it at three different locations, what happens is even if your data goes down at one place, it is still available at the other place to use it or to recover it rather. Now, when you talk about this particular data storage method you can read something called as extends in the slide now extends are nothing but these chunks those 2GB chunks which are there and when you process this data using Thing called a zero SQL which is a language that your data Lake uses. It actually goes ahead and Maps various vertices, which lets you keep track of all this data that is there. So yeah, these are the terms that is extent and vertices. Now what happens here is since you're replicating this data and dividing it into chunks. You can actually go ahead and process this data parallely saving a lot of time and giving you high computation. It also supports replication of data. This is something that I've already discussed. So I would just move further and try to talk about other Concepts as well. Next we are going to understand what the data lake is and what the data warehouses now, why did I bring this topic up? Well data warehouse is something that is a traditional approach towards storing data and it is still used widely. But then why do we need data Lake and why am I comparing these two terms will quite a few people confuse these two terms as and what is the difference between them? Exactly? Well the quite similar to each other but there are slight differences which are important and I felt that we should have gone out and discuss those that is why For this slide here. So let's try to understand that as well. Well, this is a clear differentiation between these two things not as first of all you need to understand that your data lake is nothing but something that is complementary to Data Warehouse. That means if you have your data at a data Lake that can be stored at data warehouse as well. But there are certain rules that need to be followed. Now when you talk about your data warehouse, what happens is you can use again your data Lake to bring in data, but the main difference is so when you talk about a data Lake the data is detailed data or raw data. That means it can be in any particular form. You just need to take the data and dump it into your data link that is not the case with your data warehouse here. The data is filtered summarize refined now, you might wonder that. Okay, if everything is happening here at your data warehouse, isn't it better in some situations? Yes, definitely it is better. But as I've already mentioned so many times in this video the amount of data that is generated. These days is huge and it can come from any particular source. This might not be the best of options to deal with why well, your data leak has something called as schema on read and your data warehouse has a schema on right kind of an approach what this does is if I talk about it from a data warehouse perspective where you have scheming right? That means when you're writing a data to your data warehouse, it is written in a structured form or in a particular schema. So when I'm reading this data, I have to read it in that schema only but when you talk about a data Lake here you just dump your data it is not Structured so when you are using this data, you are free to go ahead and Define your schema in a number of ways as it suits your needs. So this is where the benefit lies in that is the data does not follow a particular schema. You can just go ahead and pick a schema for it. So that is a plus Point again one more Point your data warehouse. Basically, it works in SQL. That is it uses SQL to choir or question your data, but when you talk about your data Lake no matter the data comes from different sources, it can be acquired by using one single language. That is your USB. Good and again that actually helps you reduce various barriers because you are talking about different data sources, but still something that lets you access the data is one single programming language. So these are some of the concepts I felt that you all should know that has what a data factor is and what a data lake is again. The reason I talked about data Lake was it is an important part when you talk about data warehousing and data integration because all these topics would form a base when you talk about analytics and processing data and that is why I wanted you all to know all these terminologies now since we started our session talking about data Factory, let us move back to data Factory and try to visualize all the concepts that we talked about because I talked about something called as pipelines activities and all those things. So what I'm going to do now is I'm going to go ahead and give you a demo where I'm going to actually go ahead and create a database probably load a table in it and then move the data from that particular source to a blob storage using a data Factory. So yes, this might be a lengthy demo, but I'm sure that you all would like it and have something new to learn out of it. So let me quickly switch to my Azure and we can actually go ahead and see how it works. Okay. So there you go. What I have done is I've gone ahead and I've logged into my so called Microsoft Azure portal for people who are completely new to this term. That is Microsoft Azure. What you should do is you should go ahead and take a look at other videos if possible. I've created quite a few videos in the series and those videos talk about various Concepts as far as Microsoft Azure goes there are certain Basics as in how should you use it? And what are the things that you need to do? One of the things that is there is creating a free account, which is very important now, Going to go ahead and use our free account or are subscribed account what Microsoft Azure does is it lets you have a free account? You need to just register for it and quite a few resources would be made available to you and some credit is also given to you which you can use that is you would be charged for these resources. But since you are given certain credit you can use that and that means the services are freely available to you. If you already have an account, then that is not a problem. We are just going to go ahead and take a look at the demo part as far as this demo goes. What I'm going to do is I'm going to go ahead and create a database for that. I need something called as SMS. Let us go ahead and try to understand what that is first. But if you do not have that thing you need to go ahead and install it. So how do you do that? Just go to Google basically and type SS Ms. This is the first link that you get and you open it. You have your SQL Server management studio. Now, this is something that we would be needing. You just come here and you click on it and it would start the setup download. Guess it's getting downloaded twice. I don't need that. I've actually gone ahead and I've installed that thing on my system. I'm doing this for you people. What you need to do is you need to download this particular file. Now as you can see, it is somewhere around 800 MB s that is approximately equal to 1 GB. So you need to download that file. And once you do go ahead and download that file you need to install it in your system. The installation can be a lengthy process. Now when I say lengthy process it can be time-consuming. It is not difficult to do all you need to do is open this file. File and double click on it. It would give you an option to install it and just say yes, once you do that, it takes care of all the processes and once you do go ahead and install that thing now, this is something that would help you have your own server and that is on your local device basically, so this is something that we would be using in the later part. But what I would suggest is you come to this website and download this particular thing, if you do not have it and once you download it, I would suggest that you go ahead and install it as quickly as possible again. Let me tell you it might take some time. 15 minutes depending upon the processor you have and the internet speed that you have. So yeah, once you're done with this then what we do is we are going to switch back to our Microsoft Azure account. Now, what I'm going to do is I'm going to go ahead and create a database here. So how do we do that? Well, you go to your portal basically. And quickly login to your so-called account. My internet is fairly slow today. So, yep, it might take some time. So this is how you are Microsoft portal looks like you have quite a few things to select and choose from you can just go ahead and click on create a resource here and it gives you quite a few options to select from or instead. What you can do is you can just come here and look for your so-called databases and I select an SQL data warehouse. So it would ask for a database named give it a proper name. Say the move DB is what I would call it. And yes, the name is acceptable. My subscription is as your 533. I would be needing to create a resource Group for people who do not know. What a research group is. It is nothing but think of it as a place where you put in all your resources basically, so it is a group of resources again, if you need to understand more about it, we do have a session on it, which you can take a look at it on YouTube. So I take create a new one say I call it demo car G and let me just pick a blank database. I need to configure server to it. So I would say create a new one. Let's name it say. The most server and I should give it some numbers probably. Yes. It is acceptable and you need to create some login credentials when you do log into the server. So let those credentials piece a admin demo. Maybe there you go. And what password should I set? Let it be strong and let it have a number and symbol basically Location South India that does not matter a lot you can choose the location that is there in here. You have quite a few options. They go out stick to what it is there and I would say select. Yes. So I have a demo server as well performance level now. It depends as per your need as in how fast do you want it to work now as far as my so-called demo is concerned. I do not need it to be very fast or something like that. Let me have it with this value now based on the location where you've created your so-called. Called research the prices would be given to you. Now. This is something that I created in South India. So the price to me is an INR that is Indian rupees and it is to 23.8 it per hour. All I would do is I'll just go ahead and apply. I would say I've been to dashboard and I would say create. Now the deploying might take a little longer than normal because yes as I've already mentioned that it depends on the internet speed and even if your internet is faster at times it might take a longer while for this thing to happen. So what I'll do is I'll just pause the video for a minute and once the deployment is done. I will get back to the demo part again. So yes, guess the gone ahead and done the process. That is we have our so called mod b already it took a while. I actually went back and had a cup of coffee as well. It took that long. My internet is really slow today. So yeah, let's move further and now try to go ahead and do the other thing that we are supposed to do as I've already mentioned. You need to go ahead and install ssms if you do go ahead and install it and this is how it would look like I've since we've already created a database we can log into it. You can go ahead and give me your credentials here that is I would do putting in the credentials which I've mentioned that is demo. So 1 1 0 0 and then the extension that is. Database dot windows.net. Yes, and the name here is admin demo. I can go to options here connect to our database. We have something called as the Moody be and that is 3 2 1 TCP IP. I say connect. It wants me to sign into my so-called as your account. I hate this each time. It happens because I've already logged in I should have stayed signed in but I did not and that is costing me now. Yeah, one more thing at times you would be logging in from your client user or your client PC and that times you might not be an administrator. So in that case you need to change the firewall Rule and make a system accessible here. And there you have signed in. So we have our information here. That is this is my serve I used to login and if I click on databases the schema is there we have a database. That is mod b 3 2 1 now what we can do is we can actually go ahead and add a table to it. Now. I'm not going to go ahead and create a table a completely new table instead. I'll just go ahead and maybe run a simple query which lets me have two columns. So what query should I put in what table should I create? I'll just go ahead and pick up some query from Microsoft Azure website. Now. This is something that lets you create a table with this name, and these are the so-called variables are column names that you are so called table will have so I'm just going to copy this piece of code. If you wanted you can go to Microsoft Azure website and you can have this piece of code as well. I will share the link do not worry. So when I close this and I come here and I click on this. So I see new query. And I simply go ahead and paste this piece of code now. I'll just make some changes to the name just to get it off ambiguity. Say two maybe three and I would be inserting two records in it. So this is the changes I make here that is insert into this so-called table and to do that. I would say execute but this should not take this long. But at us now, once it does happen, these are the two records that would be there. That is John Doe and Jane. Doh there you go. One R is a vector is what it says. So we have actually gone ahead and logged into my SMS and we have connected to our SQL server and we've created a table there. And as far as the table goes it has these two records. So what I'm going to do now is I'm going to again switch back into my so-called other data Factory that is to my other account and create a user data Factor basically, so how do we do that? First thing you need to understand is in order to have a resource Group or have all these? Resources there on your system you need to have a storage account. Now. This account is nothing but more or less a compliance or a law. Basically what that law does is it lets you have your storage entities on Microsoft Azure. So let us go ahead and create that account first. It is very easy. You come to this portal once you do that you just scroll down and you see storage accounts here and I say add when I say add This window should appear and you need to enter in details. So what details should I give information storage account? Let's call it say essay for demo now. It is not accepting this name. Okay needs to be in lowercase. So I would say essay for demo and there you go. It is taken resource manager is what I stick to and I say V2 location is South India now, I've talked about your I'm getting replicated three times that is three copies of maintained and when I talk about the replication, these are the types of replications that you have locally redundant storage, which I am selecting which is the most affordable one. It is not very reliable. But since it is a small demo I can use this performance should be standard and if you see by default The Blob storage is always hot and when you talk about a resource Group, let's go ahead and use the one that is already. There are Resource Group was demo or GIF. I'm not um, yeah, let's select this you need to dashboard and I say create and my storage account would be created. This should happen quickly. There you go. The deployment again might take a long while. So yeah, what we've done is we've gone out we've actually created a database you've connected to server put a table there. And now I've created a storage account since I have a storage account. I can go ahead and create again containers and then I can use data Factory to basically move data between various sources as you can see it has been deployed. Do I want to go there? Yes, I do. When you come here, you see this so-called tap here. You have something called as access keys. What you can do is you can actually come here and copy some of the data that is here. This is the name of your storage account which you would be needing and the quite a few terminologies that you need to remember when you are using are going through this demo. Like I mentioned you have created a database you need to know its name or remember its name. You need to know the server name. What is a server admin credentials plus? What is the name of your storage account, which is this in this case the key. I'm not sure whether we would be needing it or not. But if we do, I would still say that you copy this. Whiskey that is here control a control C and I would just paste it. There you go. Now when you move back to this page, you have this option yet blops where we're going to go ahead and create a container. You can click on it as you can see there is no container here. So you click on this plus sign and you have an option to create a container. So what do we call this particular container here? Let's call it's a blob again. You need to use something small. That is demo new blob. Maybe is what I'll name it. And a lady Public Access level be the way it is and I would say okay and my blob is created here. Now, I won't be adding a destination folder or something here because when you do go ahead and move your data destination folder is created automatically. So let's not do that. Let it be the way it is. So I have a blob storage or a container with me. Now. I need to go ahead and create a data Factory here. So how do we do that? Come here search for data Factory directly. There you go. Now this is not where I wanted to be so I closed it. I click on analytics and here I have the option of data Factory I click on it. Yes, so I can create a new data Factory. So what should I call this? Let's say the mod f It's still not there. So that is surprising. Okay, let me just try few names and come back quickly. So this name is accepted now. So use an existing Resource Group, which resource Group did we have it was demo as if I'm not wrong. There you go V2 is the latest version that we have and we need to bother about this thing. Let's say okay. These are the areas that are there in the option. We select this pin to dashboard and I see create an I have a data Factory with me. So this might take a while. So let me again pause it and switch back to the time. No, I don't need to do that. It's created. Okay, so I have a data Factory with me now. I need to come here and click on this because I need to go ahead and move my data so I come here. When I click on this thing, I would be given quite a few options to deal with so I need to copy my data. So I click on this icon. There you go. I need to give a name to the task. That is there. Let's call. It's a copy from db2 block. And I go to next. I need to select an SQL Server here. So I come here and I scroll down now the interface might vary from different portal accounts. This is what it looks like as far as my so-called system goes SQL Server. Here it is. I selected and I say create a new connection. There you go. You'll have to scroll down right at the bottom scale server server server. Did I miss it somewhere? Yeah, here it is. You select it click continue and you need to give a name to your new link service. And what name should I give it to you? Chase kill server demo link movie And I also need to go ahead and create an integration environment. So I come here and I click on this thing and I say create new public network. I see next. So what name should I give it to it? Let's call it set demo integration, Maybe. And I said finish. Now as you can see, what we've done here is I've gone ahead and I've been given in details for my so-called source. That is the place from where I'm going to go ahead and use all the data. So I have this so I need to go ahead and given my server credentials again. So if I'm not on the name was I'm telling you you need to write everything down because you would be using all these names. So a best practice would be to write everything down. So in my case, it was something like demo Server 0 0 1 1 if I'm not wrong. 21100 the extension is not database dot windows.net. There you go. The database name was the move DB 3 2 1 SQL authentication user name was admin demo if I'm not wrong I scroll down and I enter the password that is and I say finish. So you're my source details are given in already. That is this is my source data store. And these are the informations are this is the place from where I would be wanting to move in my data. So I go to next and then I enter the details about the destination now, But before that what we do is I need to select a table. If you remember we had run a small SQL query to give you the details. I do not remember the name it was what was the name of the table? Was it EMP 3 was it yeah. Let me just refresh it to see if the information is there or not. I scroll down and it is here. So I select it and it would load the previous thing that okay. These are the records that are there now these were the records that we entered so I say next. For my destination I will come here and I would select a blob storage. Now. There you go. Create new Azure blob storage and I say continue now. I need to enter in details here as well. Let me just call it say as your storage. No more ink. Let me just do this thing again quickly. We need to select a storage account name as well because we've gone ahead and created a storage account here, which was for the demo part in What was the storage account? I forgot the name of it. It was storage account for them if I'm not wrong and I've selected that and then I say finish. I click on next. Now this is the service that I wanted to connect to. I say next now. I have to enter the so-called details for that. I would be actually needing the name of my blog which I think I've forgotten. So let me just go ahead and get the details of that as well. It was something like this that is demo block and the file name was MP3 if I'm not wrong I see next. I see next next again and I say next. And there you can see the data has been deployed that is I've actually connected my skill server and I've gone ahead and I've moved the data to my so-called blob storage, which you can actually also do then you can go ahead and edit the pipeline if you want as you want or you can just go ahead and monitor this data as well and it depends on your needs as a note you want to do you can go ahead and do quite a few things with it that has you can go ahead and move this data to your so-called power bi and Implement various other things on it as well. When we did go ahead and create our so-called. Blob storage that is block container. You can actually go ahead and keep that part or that so-called window open because when you do guard and deploy this data, you can see all the details not as what has just happened and how has it happened all those things. So yes, what we've done is we've gone ahead and we've moved our data from our so-called database to our blob storage. Now, I actually accidentally went back and did not go through that step where we see the deployment, but do not worry we can just go back to our dashboard and take a look at that thing as Well, so how do we do that? I have this so-called storage account here. Now inside that storage account. We have our blops where we move the file. Now. This was the block where we moved the file. And then this was the file that we moved. So yeah, our deployment has succeeded. That is we move data from a so-called database to show called blob storage. And as far as this demo ghost that is what our aim was. I hope that I did through a sufficient light on following concepts that as our data. And how do you go ahead and create a data Factory in use it as a pipeline? Basically today. We're going to go ahead and talk about machine learning and to implement machine learning models. We would be using Microsoft Azure before we do get into the details of these topics. Let's take a look at the agenda of today's session first. So first and foremost, I would be introducing you to machine learning. Now it being a very vast topic. We would be first taking a look at some of its fundamentals. And then we would be switching to Microsoft Azure and we'd be seeing how machine learning can be implemented by using Microsoft Azure. Finally. I would finish things off with a demo part where I would be talking about has our ml Studio that lets us carry out machine learning processor. I hope this agenda is clear to you guys. So let's move further and get started with the first topic of discussion. That is what is machine learning. Well, if you go by the definition it is nothing but the process where you teach a machine to take in some data analyze it or understand it and based on that data. Given some valuable outputs. Now. This is a very generic definition but to give you more simpler and example, I would say that it is something similar to how we human beings learn. I mean when we are born we have no idea about anything that happens around us, right? I mean, we do not know what shapes are what colors are But as time progresses and as we hear people talk, we see stuff happening when we learn to write. We actually go ahead and understand these things Ellen. What shapes are what colors are what people are in all those things. So machine learning process is very similar to this. This I mean what happens here as well is you provide in some valuable data to your machine and you train your machine with that data again, and again again and again or with new data as well. Now your machine takes in this data and it builds in a pattern or an algorithm using which if similar data is given to that machine it would be in a situation where it can probably classify this data or predict something or collaborate this data into something else. So this whole process is machine learning now as I've already mentioned machine learning is a very large domain as we move forward. The View would be discussing these terminologies as in classification and all those things but for now in simple words, it is nothing but the process where you're given some kind of data to your machine, it understands that data and based on the data it helps you take better decisions. So let's move further and try to explore or understand some other topics as well. So what do we have next? Let's take a look at some of its fundamentals. If you talk about machine learning we need to consider two important points that is supervised learning and unsupervised learning. Now. These are two important classifications if you talk about Machine learning. We also have something called as iterative learning as well, but we won't be getting into the details of that. As far as the session goes. We would be sticking to supervised learning and unsupervised learning. So when you talk about supervised learning it is nothing but a process where you actually go ahead and teach a machine to predict something based on the information that you already have or you at least know the target variable to be more precise. Now, what do I mean by this? Well, in this case, you actually know what your final outcome should be. Like, are you at least have the Meters that help you govern your final output when you talk about unsupervised learning. That is something you do not know. Let's stick to supervised learning for now and consider this example suppose you have some data set where you have information as in you have some data where you know that certain values or certain records are for ducks and certain values are not for ducks. So what you do is you pass in this data to one of your machine learning algorithms. Are you build a model around this data and when you pass in a new value to this so-called Model that model should be able to predict whether that value is for duck or it is not for duck. Now in this case. This value is not meant for ducks. So the answer should be not die because we can clearly see from the image. It is a piglet so that cannot be a duck. Now. This is a very simple example of supervised learning what we are doing here is we know that what kind of output are we expecting? We are expecting an output where we know either it's duck or it's not duck so our Target variable is free. I mean, we know what we are researching for or what we are analyzing the data for these kind of algorithms are called as supervised learning algorithms or this process is called as supervised learning. So this is a part of machine learning now important point to note here is your data is labeled now. That is what I mean by the Target variable which I just talked about. You know what your final value is and that is why your data is labeled. You know what you're trying to predict or what your final outcome is. So this is a very important. Point to consider your data here is labeled and you know your final goal as in what are you trying to achieve? If you talk about the next method or next approach that is unsupervised learning here. You do not have labeled data. That means you do not have a final Target variable in this case your final Target variable are attribute. It can be random or it can vary or once your model ends. You would be reaching there. But that is something which is not consistent that can vary depending upon the needs that you have. Let's take an example to Stand this a little more as you can see we have some pictures are on the screen. You can see certain species of animals and birds. So if I want an algorithm to classify these pictures are this records into their clusters. This would be more or less and unsupervised algorithm. Let's take a look at it first. So as you can see we can pass in this data to our unsupervised learning model or build a model around this data. Once that is done. It should be able to classify. My data into different clusters as you can take a look at the Clusters, you can see that it has classified my data into ducks and something that is not Ducks. Now, you might wonder as a look at this is similar to what happened in supervised learning, right but in supervised learning that is what my target was. I knew that I wanted to predict whether it's a duck or not. In this case that might not be the case because say, for example, I have this data where I have animals and birds and I do not know what animals and what birds are there. They might not be ducks in it, right? They might be just Yes, they might be just rabbits and all these things or you might want some extra clusters as well. For example, I want to segregate words. I want to segregate animals. Now in this case. My final output is wearing it can differ right? I mean, I might expect different outputs out of it. So since I do not know what my final output is, I do not know what clusters are getting formed here. So that is why this kind of algorithm is called as unsupervised learning where this is more or less similar to your black box testing kind of a process where you do not know what your final output is, but you do run into Your algorithm and then you expect a more organized output that would lead you to better decision-making and important point to note. Here is the data are is unlabeled. I hope these algorithms were clear to you guys. If you do have any doubts do let me know about those as well. We would be getting back to you on those doubts as well. But in simple words, this is what supervised and unsupervised learning is now let's move further and try to understand some other things as well. If you talk about different machine learning algorithms, you have these classifications here first, we have supervised learning and in that we have something called as Creation and classification. Now, these are two of the most popular algorithms or two popular branches of machine learning algorithms. If you talk about regression, it is a process where you try to find out relationship between two or more variables suppose. I have to detect as an if I smoke would I be having cancer or what is the probability of me having a cancer now? This is an example of regression because I'm trying to compare cancer with smoking right? So I'm trying to find out a relationship between these two. So these kind of algorithms are called. Has your regression algorithms and then you have something called as classification now in classification you basically classify a data into groups consider this example. I need to classify my particular data set or information into different segregations or into different parts, like male population female population and all those kind of stuff. So these kind of algorithms are called as classification algorithms. And if you talk about regression and classification, you have quite a few Advanced algorithms as well. Say, for example, you have random boost XZ boost and these kind of algorithms are Not random blue sari random forests. So you have these kind algorithms which are advanced level algorithms. Now, we won't be getting into the details of those algorithms but those are important as well. So once you are through with what regression is what classification is, I would suggest that you do go ahead and explore those algorithms as well moving further and talking about unsupervised learning. We have algorithms like clustering the example, which I gave you in the unsupervised learning slide was of clustering so that is one method or one type of algorithm that Sighs learning supports, then you have something called as Association now, we all go to supermarkets, right? We buy stuff probably we go to buy some breakfast stuck in that case. You would be buying breads butter, maybe milk, right? So what shopkeepers do is or what supermarkets do is the normally place in products that people might buy in bunches or in groups and this kind of process is called as collaborative filtering or implementing Association laws rather. So what these Association algorithms do is they help you. As in what is the probability of people buying certain products combined with other products? Because it is understandable for people who are buying breakfast up. There is more probability that if you buy milk, you would be buying bread with it as well. So yes, this is something that falls under Association and dissociation laws, but that is a topic for some other time. I just wanted you to give you an introduction of what supervised learning is and what unsupervised learning is I believe that it is clear now, so let's move further and talk about something else. Yeah. So now we've talked about what machine learning is. And what different kind of machine learning algorithms that are there now, I would like to brief you through the process of how machine Learning Works actually and this is pretty much common for most of the algorithms that you're going to implement first and foremost. You would be needing data. Now, I've already talked about the point that data is sent it to machine learning. If you do not have data you cannot make any predictions and more the data the better it is for you. So the first part is having data and once you have the data the next point you need to confirm or make sure is the data is appropriate for machine learning and this is We're pre-processing steps in what pre-processing does is it helps you process the data that you have and prepare it for machine learning. I mean your data might not always be cleaned there might be some missing values some repetitive values, which you do not want in your data when it is getting processed. Right? So in this case we filter out this data we clean it. We fill in certain values. We predict certain values and be putting those values there. And once this data is up and ready for working then we pass it on for the and then we provide a particular machine learning. This again is a trial and error kind of method where it seems simple at times because we have discussed all those machine learning algorithms, right? So to naked eye or two naked men. Basically we might think in this Direction Where We would think that okay. This is the kind of problem. I'm dealing with so this is the algorithm I might use but that is not the case at times the data is misleading. We are not sure what kind of algorithm I want to use. What kind of data I want to pass on how much data I want to pass in that case. What we do is we first a lot a particular algorithm use it implemented then we test the values then we try out some other algorithms as well. And then we come to a conclusion as an okay. This is the best algorithm and using which I have generated a model which is best to meet my needs and while doing that there are quite a few processes that happen processes like training testing validating where you pass in certain amount of data you build the model you train the model and then again you pass or keep some data behind which you later pass to test these models as an are they working properly or not. So this is an iterative process and this might take in more than one. Chance to actually go ahead and jot down or settle down onto a particular point. So once your algorithm is selected, once your machine learning model is built you can actually go ahead and deploy this model into your environment or real time working where it would be able to predict the real-time data the data you provide your so-called algorithm, right? So this is how the whole process of machine learning works now the processes which I talked about pre-processing than implementing various algorithms training testing a data now this again the look simple or when you listen to them. Um, they seem pretty easy as in training the data and all those things. But once you start implementing these things it is fairly difficult ask any data scientist and that person would tell you that pre-processing is something that is very difficult to deal with and mostly sixty to seventy percent of the work is done in these Pages only. So what if we had something that could actually help us hear what in that b is I mean if we could just speed up this process of pre processing algorithm selection training and testing data instead of doing this manually. Can we do all these things automatically the answer is yes. This is where you are Azure machine learning steps--and what Azure machine learning does is it helps you carry out the whole process but as you can see we have something called as ml studio and it focuses on your pre processing application of algorithms and deployment processes. So while cop the task where which can be repetitive or which can require you to put in more efforts to implement manually. It actually helps you automate or speed up that process. So that is what ml studio is. Basically it is a Our a service in a very popular cloud service provider. That is Microsoft Azure, which lets you implement various machine learning algorithms and it carries out the bulk of tasks or the bulk processes, which you would otherwise not want to do. Now. This is not something that actually is used to replace data scientists. You cannot do that. So no offense to any data centers who is listening to this video or going through this video. It is more or less complemented to data scientists. You would be needing statistical knowledge. And hence. We talked about machine learning a little because even if you build and models using Azure or any platform you would be required to have proper statistical argument or knowledge about data science something that would help you understand the output of the models that you've built. So yes, some statistical knowledge would always help when you cannot replace that but definitely if you are working on machine learning and you need to speed up this process or make it more efficient than Microsoft Azure and ml stood in particular is a very important resource for you to have so what I'm going to do now is I'm going to switch into the demo part and Would the building a model so that we can discuss some of this stuff that I've already talked about and we also get to see how Microsoft Azure Works in real time. Right? So let me just switch to the Azure portal or console that we have at our disposal. So guys what I've done is I've gone ahead and I've switched into my Microsoft Azure portal for people who are completely new to Microsoft Azure. You can actually Avail certain services that Microsoft Azure offers you for free for one month now during this period you can Avail certain credit. For u.s. Citizens or people who have an account in u.s. Region. They can actually have a lip to $200 of usage where you can use certain Services. Now these services are chargeable that is why the free credit that is made available to you. So which I believe is more than enough for one month's practice. So if you're somebody who's new to these platforms, I would suggest that you go through or sign up for Microsoft Azure and you can Avail those Services now since I am from India, we have Indian rupees as our currency and for our usage we You went somewhere around 13,300 INR or Indian rupees which is a very big amount if you talk about using a service for a month's time, so it actually serves my purpose. I have been using it for a long time that is this particular account. I've had couple of accounts but this one is something I created some 15 days back and as you can see I still have like 12,400 something something which I can use and we would be not needing this much today somewhere maybe 10 20 Rupees to the max. And so yes, you can go ahead and create this account. Once you do have this account. Then you would be having access to all the services that Microsoft Azure has to offer to you. You can go ahead and create all the resources you can have or utilize its compute Services storage Services database services and all the services that it has to provide to you. But since we are talking about machine learning we would be sticking to those applications as well. So in order to use your Azure machine learning, you need to create a workspace where you can actually go ahead and put in all your data and once Create your workspace. You actually need to go ahead and sign in to the Microsoft Azure. Ml Studio, which is an interface or IDE where you can actually go ahead and create all those models. So in order to go ahead and create a workspace. You just need to come here and type machine learning and you might be having that thing in the suggestion. It was already typed. I believe machine learning and you have this place where it says machine Learning Studio workspace or service works. Space you can click on these the studio workspace has something I've clicked on and you need to put in some details as in what is the name of your workspace? What subscription are you using Resource Group? You can use the one if you already have one. If not, you can create one just given some name. Our research group is something that holds in details about your resources that you're using and then what kind of storage account you are using you can create the storage account as well. It's not a big deal. It is nothing but think of it as a storage place where you can store in your data, that's it. So you Go ahead and put in these details and then you say create before that. You have to put in what pricing tier are you using and you'd be entering the region where you want your workspace to recite now, what cloud does is it stores a data in particular locations on the globe? Right? So you can choose the location that is closer to you or closer to your business depending upon your needs for now. I'm gonna stick to the basic one that is here because we are just creating a simple demo. In fact, I'm not going to go ahead and create a workspace because I already have my own workspace, but you I would suggest that you put in these details and create one. Once this work space is created. You can actually just open it and at the bottom you would be seeing an option called as machine Learning Studio else. What you can do is you can type in this URL and you would be redirected to this page where you have to sign in with your Microsoft Azure portal account. And once you do that, you would be redirected to the ml Studio that I'm talking about. So the workspace would be created once the workspace is there. Login to your other ml studio. And once you do that, this is what you'd be having at your disposal. Now. These are some of the experiments that I might have worked out or worked on in last week or so. Some of them are finished some are still in drafts. So you can actually go ahead and create these workflows. Are these kind of workflows. Now you have so many options here. What are the projects that you create experiments which we just saw different web services that are made available to you. You can actually go ahead and create web services as well. You have your notebooks now, you might not always go ahead and start from the scratch, right? You might have your code written in maybe our or some other language like python. So you want to import that code you can do that as well or you can use the existing notebooks with Microsoft Azure has offered to you where you have ready to use codes or ready to use models as well. And then we have data sets. Now again, you can import your data sets that you have there was one Financial sample data set which I imported recently. You can actually go ahead and use sample data sets as well. Now you can see there are quite a few. Data sets that are made available here, which you can use and Implement your own algorithms or implement the algorithms that Microsoft Azure has to offer to you, right so you can do that as well. So it pretty much depends upon what do you want to do? And what kind of processing do you want to do as you can see if you come here you have some this is somewhere you can see a train models as well as in the work you've done or some models that you've implemented. So you can have that here. In this case. We are going to go ahead and Implement one of the algorithms are algorithms that are implemented by Microsoft azure. So if I come here to experiments and I go to samples you can see that we have so many implementations so we would be taking a look at one of these and then we would be implementing that on our own do not worry. We won't be copying it right away. So we have quite a few options here as you can see. Okay, let's just go ahead and do one thing. Let's build our own model here. So for that we need to go to experiments or rather. We can come down here and say new and I say add a blank experiment. Let's just go ahead and try to build a recommender system or something like that. So to do that, let's call it. Say my recommender. There you go and save it if there are no model. So you cannot save it. So first let's get started. Now in order to create a recommender for people who do not know what a recommender is it is nothing but P passing certain data and it might suggest or the model might suggest you as in what you might like or what you might want to do. Say for example, Example when you shop on Amazon or any other website that is there. You normally have some suggestions right? I mean you may like this you may like that same is with YouTube view go through certain videos and it gives you suggestions as an you. Preferably might like these videos as well. So that is a recommender system. So let's go ahead and create one recommender system. Let's create one for movies. So let's just go ahead and practice or play with the data that we have for that. We would be needing a data set first right now. If you talk about ml Studio, it is very simple. You just drag and drop stuff just like creating workflows. It is as simple as That now in order to use a particular data set we have these saved data sets here samples. Let's make a recommender systems for movie movies movie. Yep. So movies by have something in movie. Yeah. There you go movie ratings. So we would be using this data set now once you put in this data set is available. You can just go ahead and take a look at it. So let's just visualize this data and as you can see the information is here. It has certain values like user ID. Eid ratings and time stamp times time is something that people do not use frequently. But yeah, these are things that are important to us. We have factors like your ID that is your movie ID user ID and rating it's somewhere around up to 10. So I believe it has started from zero or one maybe so we have ratings from 1 to 10, which we would be using. So this is the data that we've just visualized but at times this data is not as simple and as managed it might have some missing values and you might be required to play with it or make some changes to it. You can actually go ahead and put in some factors here as well. Now here you have so many options that are made available to you. Right so you can actually go ahead and process your data a little manipulated data little like you can take a look at statistical analysis and all those things but this being a clean data would not need to do that. So we're just going to stick to the recommender system part here. So we have the data set now I need to select the columns that I want to use. So I'm going to project certain columns out of it. So for that we have a model here called as project columns. Okay, I don't see it here. I believe this. Change the name select columns to okay. So this is the one they've changed the name. It's called a select columns in data set. So we drag it and paste it here and we hold onto the circle that is there on the previous module or the tab we had and we pull it down so we can connect these two and they are connected and but since I have connected them there's an error here. It says value required now, I need to pass in some values as in what are the columns I need to focus on right? So I would be clicking on this icon here or tab. It says launch. Selector and it gives me options. So I'm going to put in certain rules. Now. What are the columns that I want first? I would say that getting all columns and just exclude the ones that I don't want. So what are the columns that are not on time stamp was something that won't be very handy. So I'm going to remove that so I would be excluding that and I would be seeing okay, once you do that the error is gone. So we have the data set. We have selected The Columns now next phases. I need to go ahead and pre-process the data, but data is already processed. So I don't need to do that either. So in this case, I would be going ahead and splitting my data into two parts my training data and my testing data training data something that we would be passing on to the model and will be training a model based on the data and test data is something that we would be holding back and then we would be using that testing data to test our models or to predict the outcome or to see whether the model is working fine or not. So to do that, we need to split a data. So come here. This process is easy. Just go ahead and type in the words that you need to do and it gives You modules to do that so split data. I just passing the data. So I've gone ahead and I've created or I've pulled this split data module or tab into my workflow. So yes, the data would be split and it would be split in this fraction Point 5 that is we would be using .5% data to test that is half of the data to test and half of the data to train our models. So there you go. I won't be tinkering with these factors. Those are good enough for me. So let's just move further now, there's an option here where you can zoom in or zoom out your Our model to fit in the screen. So the data is split now next job is to train your data. So train your recommender system. Do we have option to? Yeah train Matchbox recommender. So we select this and pull it here. Now. What we do is we pass in one of these branches here first one and the split data is passed on to this training module or tab. Now, I'm not too good with the live nomenclature. That is why this confusion let's call it tab. So yes, so I pulled in this data into the So this is something that would get trained here and I need to score it as well. So once I come here, I select this first and it shows me the details as an okay how many traits of the data that I have that I want to use to build this recommender system. Let's just say 10. Okay 10 is fine. I don't see too many problems with it. Maybe let's do it 20 number of recommendations. I want you know, this can also stay to 5 no problem training badges for is fine. So we just move further and next what? We do is we just go ahead and score the data that we have. So I say score and I pick in this thing. So again to this I would be passing in my training data here and I would also be passing in my split data. That is the testing data. There you go. So the data that has been trained at would come here in also the testing data would be here. So I have this score where I need to give in the details as an what are the predictions that I'm looking for. Now, I basically want prediction where I would be wanting related items, right if I watch this movie, What kind of movie I need to watch right? So this is what I would be interning here. So once I enter related items, it says what are the maximum number of related items to find from an item that you have? Let's say I want just one item there you go. And so it would give me one related item to the movie. So if I pass in a particular movie to this recommender, it should suggest one movie that I might like watching. So that is what I'm talking about here. So one related movie you can have more than one as well. So that is up to you. So we have done this now. Next is I built. Built a model or I've actually gone ahead and put in a tab for training and scoring next. I need to evaluate this data, right? So I say evaluate or test rather. So it says evaluate your recommender you get in here and this time you take in this value that is your score and you put it here in this column. We passed in one of these threads here. Next is we take in the split data and we enter it here. There you go. This is fine. I would Saving it here just to be safe. Once you save this data. Okay. So the connection is that we pass in these are important in which Port are you passing in what value so this might hold and this is more or less an experimental kind of stuff where you might actually go ahead and put in some wrong connections and you might get in some errors. So you actually need to go ahead and troubleshoot some of those at times not always so we've actually gone ahead and we've almost built a model now. We need one more table here or one more data set that is Movie IMDb titles. Let's place it here. It has gone somewhere. So I place it here they go and whenever we have a new data set, we always visualize it to understand what it has. Okay, this should not take this long. But for some reason it is so I have this data set where I have movie idea movie name. So I would be using this data set for my recommender where it has some IMDb titles, which is not the actual IMDb that website which we have it is the sample data set that is created. So we have this data set here. Now that we've seen the data. I'm going to go ahead and use a command called as edit metadata and I'm going to place it. It here and as usual, I'm going to go ahead and put this thing in here. Now if I come here as you can see, there's this column here, which says select certain columns, which you want to use. So what are the columns that I want to pass to my metadata basically or what is the metadata that I want to use? So I'm going to go ahead and click on launch column selector. And in this case with rules, I would start with no columns and I would say include so what are the columns I need first is I need item. So you have to hit the enter button. You won't be given suggestion here for some reason it is not taking in this value. Let me see what is wrong. If we need to pass in first values to this so-called metadata before that, we won't be able to deal with items because we just took a look at this data set and it does not have item value. That is why we are not able to pass in that value. So let's pass another value straight the values that are more relevant to this data set. So we'd be coming here and we'd be selecting some other values. Now, you can see that we have these values that are available. So let's just go ahead and select those. There you go. And I say okay so that it is gone. Now now we have a metadata which is made available to us and I have a model which is up and running here. Now. I need to put in Joins here. Now if you all know what joins do is they basically help you select data from one table to the other. So we have two tables here or two data sets. So I want to combine the data that these two tables have no I won't be getting into the details of joints and all those things but we would be using them here for the general reference sake so I have these He's two datasets here. And I want to predict our compare the table with the table that is here. So what I'm going to do is I'm going to build a model or create a joint that lets me compare the movie names from one data set with the other argument recommendations from one of the two datasets, right? So for that I would be needing a join here. So let's just come here and say join crib before we get into this thing. That is one more important point my edit metadata data type. It has to be string. They go now I To pass in values to this tab as well. So for that I would be needing a score from here. So I would be taking this and I would be placing it here. There you go. And one from the metadata to this joint now, what are the values that I want to pass in here now? It should be item I believe. So as I've said hit the enter button, there you go. And you say okay and columns from our or the other table? What do you want from here? I would be seeing maybe movie ID. They go I say okay. What kind of giant do I want? I want left outer join now again, I want to get into the details of these joints don't keep the right key columns because that is the reason I'm using this joint. They go I would be needing one more join here and I would be putting it here because the first join would just give me the movie ID, but I just don't want the ID I want the movie named as well, right? So it come here at pull in this thing and I would pass it to this data set. and edit metadata There you go. Again, if I come here it would ask me for values. I would say give me related items if you have any. And Cher I want the movie name. It's a save give you missed out on one thing. We need to come here first and remove this left outer join and now save we are bound to have some mirrors guys. So stay tuned. Now this thing runs it would run it tab by tab or module by module and then everything would be executed. This might take a couple of minutes. Once the model of the tab is executed. It shows a green tick on it as you can see here. We have ticks you're in here. This might take a longer because we have increased the number of iterations to 20 in the slide or in the table when we were working on it. So the whole processing might take a little longer than normal. Okay, it says related item not found. Let's see. Why is that happening? Launch recommend a selector. Yeah, this is the one that is the related item one. Probably there is no related item variable in the data set that we generated now as I told you in the first model, I'll show you where first. Let me select this for now and let me say okay here in this core Matchbox. I had passed a number of related items, right? It was one so by default it was given a name called as related. One so that is something which we are passing in here or something that we would be displaying. So there you go. So what we've done is we've actually gone ahead and put in all the stuff that we wanted to let's just see whether it runs and once it runs I would be explaining this again to you people. So do not worry first. Let's run it. Now this time around it should happen quicker because most of the stuff is done. We just have the error in the last tab or the last module. So the other part should be done quick as you can see and now now the last one would be implemented and it is done already. So guys our model is up and running. Let's just go ahead and check. So when I click on this icon and I say visualized you should give me some values see how relevant values these are. Let's just verified now this being a model it might not be that accurate, but let's hope it gives some values. It is not giving me the movie name and movie ID for the other section or the related item. Let's see. Why is that the case but it says if you have seen this movie you might like this movie, but we do not have that movie. So let us see where we have gone wrong first. So there is some mirror here or here we have a movie idea. So let's just come here and see. Okay, so we can just match idea to idea or map ID to ID. So let's remove this for now and say movie ID and then see whether we get the output. So I save not save as I would say save and I would run this Again, you should run quicker than the last time. There you go. Now, let's just see what is the output that we get. So I say visualize and there you go guys. It's a simple as this. I mean you put in or pulled in some values and we detect certain values and we have this result here. Now, this is an Indian movie called as the Lash and it says that if you like this you might like this Oblivion probably Jack Reacher. I haven't seen either of this Iron Man, you might like stand by me. So I don't think this recommender is that accurate but probably I'm sure that there would be some movies in it which are more Notable so and for people who are big movie fans, they probably would be able to relate a lot more to the movies that I hear. So again, you can actually go ahead and select the number of related items that you want to select and you might actually go ahead and Pinker and tailor your algorithm a little more for that. You have to play with the values that are there you have in this algorithm. You can just come here and switch in these details and probably the answer might wait the depending upon the inputs that you pass to this algorithm. So this was my basic game. I wanted you to get some Hands-On on Azure machine Learning Studio. You and nothing more than that. But as far as this model goes or this particular session goes we've actually gone ahead and taken into datasets. We've actually gone ahead and build a model train get tested and then we've used a joint to actually go ahead and see what would be the possible movie that you might want to watch if you liked one of those movies. So again as I've already mentioned it might not be that accurate. You are free to go ahead and play a little more with that you can pass in your own data sets as well. In today's session we would be discussing yet another interesting topic that touches up on cloud computing domain. Today's topic of discussion is azure iot before we move any further. Let us take a look at the agenda or the offerings of today's session first. So I would start this session by talking about what is iot that is Internet of Things moving further would understand what is iot on Azure that is a cloud platform. Then we'll talk about has RIT components and their uses and finally I would Finish this session by discussing or giving you a slight or a smaller demo. I believe this agenda is clear to you guys. So let's not waste any time and quickly get started. So what exactly is iot now coyote has many definitions. I mean because the domain is so wide or I should say there are so many things that you can do with iot that to Define it in one single wave would not make a lot of sense. I mean you can think of it as an approach that lets you collect data. It is an approach that makes a devices. My daughter it is an approach that basically helps you connect devices now to keep it simple. We all are social beings or most of us are definitely I mean, we need some social contact, right? So what we do is we basically communicate with people we tell them what we feel like or what is happening in our day-to-day life or we take in inputs from them in similar manner, right? So in a way, we are actually exchanging information. We are actually exchanging data. What about devices? I mean devices do store data. Today do have information that might be useful to human beings. But how do you collect this data? How do you make use of this data? Well, yes, you have devices that let you collect data for you. There are devices that are smart. And they do a lot of things that you would want them to do. But what internet has done is it has enabled you to connect these devices with each other and that has actually simplified the process of collecting data and also making these devices interactive and She'll in one way or the other. I'm sure this is not making a lot of sense for now. Let us move further and try to understand this topic a little more. Now when you talk about the rise of Internet, what you would notice is these days there is a lot of data that is generated online. I mean the amount of cell phones being used these days the amount of applications that run on these cell phones the shopping you do the food you order the remaining stuff the browsing and stuff like that you do and the amount of work that you do here. I mean it generates huge amount of Data of this data can be very useful. I mean you also have analytics data science in the market these days and what it does is it basically lets you collect this data and use this data in a number of ways to serve the customers better to basically make better medicines to make better machinery and stuff like that. Right? So that is what data science has done and that is what internet has done. But what this also means is a burden on human beings to collect this data. I mean you need some way or the other to collect this data. And when it comes to human beings, yes via the sharpest beings on the Earth, but the problem here is the human accuracy at times. It can go down or it cannot be as accurate as the machine is so you need to create machines that let you collect this data. So what internet has done here is if this data is used and the amount of data that is being generated is used because of Internet. It has also given you a solution. The solution is Internet of Things. What it does is it lets you connect different? And devices together and by doing that these devices are smart enough and they can collect these data for you so that your only job is to go through this data or use this data and that is why these devices are being or becoming more smarter day by day not to give you a very simple example if I go home and basically what I do is I remove my wallet. I remove my bike or car key and I keep it on the desk that is close to my door or I rather hang it on the hanger that is there. So What mostly happens is when I leave my home. There are chances that I forgot my key. I forget my wallet, right? What if they were smart devices that would tell me that I have forgotten my key. Once I leave the door. Wouldn't that be nice? So that can be done. I mean you have sensors these days you can have sensors on these devices on the keys on the wallets that you work on or on the wallet that you have. So basically what these devices would do is they would basically sense the fact that you have moved out of the house and once you cross Ross a particular range probably what it would do is they would throw in an alarm with some device that you have with you. So now this seems little impractical but our seems little complicated to do but the simple achievement out of this is you get notified. No sooner you miss out certain things at home and this application can be used on the longer run to solve different kinds of problems. Now, this is one of the applications of iot internet can be used here different sensors can be used yet different devices can be used to connect. The each other this was about Hardware devices basically can connect applications with each other which reset on particular Hardware. So this is one very basic application. There are a lot of things that you can do with iot. So as you can see in the image what iot is doing is it is basically helping you connect different applications different businesses different Services together and the fact that all these things are connecting with each other there is live data with you and that would help you solve a lot of problems. I mean you can do better weather. As with iot you can do better traffic predictions with iot. You can better figure out as in what kind of data a person is using. You can figure out what kind of exercise routines are person follows. So all these things can be dealt with with iot. You can prepare better medicines. You can gauge how basically medicines are administers and what administered and what kind of effect are they having on that particular individual. So iot is a great Boon for humankind if used wisely. So that is what iot is I Believe by now if you want Stood what iot is let us move further and try to understand the other topics that we mentioned in the agenda. So guys next on this list is iot on Azure. I mean, why should you use iot or Internet of Things on a platform like Microsoft Azure first, let us try to understand as you're in a bit now when you talk about us or I can think of this power consumption analogy. I normally use these in my sessions. So let me just throw in some light on these topics so that we can understand what other is So basically think of azure as a platform that basically provides you with services that help you solve various computation storage and application development issues. How does it do that? If you take a look at this power consumption analogy, what you'll notice is when electricity flows into your house you basically consume the electricity and at the end of the month you pay the bill for the units of electricity that you've consumed right? You do not have to worry about how does this electricity flowing who manages it? And once this electricity goes down. All you have to do is you have Call the power supplies and they take care of it. Right you do not have to worry about managing the units you've consumed. All you have to do is take a look at the bill and pay the bill. So basically what is happening is someone else is taking care of all the things that are related to power consumption. All you do is you Outsource this work to someone else you use the services and pay for the services that you've used. It is very simple and very realistic in real life when you talk about software development. There are a lot of constraints. That one has to face. I mean Buying servers hosting applications maintaining monitoring those applications. What if you were given Solutions ready to use Solutions where you had to worry about just the data that you have and take our deal with Better Business insights and stop worrying about all these issues. Wouldn't that be nice when you talk about Microsoft Azure, it does exactly that for you. It provides you with cloud computing Solutions or it provides you the platform that solves various issues that are related to your software development. So it is similar to the power consumption. I believe it is making some sense in this case. Your Azure is basically your electricity provider in terms of software Services, right? So that is what Microsoft Azure is. It is a cloud platform that provides you with various services that concern Computing and software development and you can actually go ahead and rent these services and use them for a particular time duration when you want to use them and you can get rid or release those Services once you are done using them. So this is what has Horace and why should you use iot on Azure Veloster is one of the leading cloud service providers and that is why when you talk about has or what it does is it basically provides you with various Integrations various services that would help you implement iot services on top of it and with ease to give you a simple example not this is an image that directly picked up from Microsoft officers website. If I'm not wrong, I would be giving credit to them do not worry about that. But this is a very simple example and this is what it demonstrates. It's I mean you have an iot Hub, which is an iot service that is basically giving data to your stream analytics which can be visualized by using different has your tools. Now when you talk about has our services that our services for everything by a data visualization machine learning data warehousing data Lakes you have application creation pass service creation instance or virtual machine creation Storage security in everything is taken care by has your so basically if you have applications that run on Microsoft Azure, you can actually Really go ahead and apply internet of things to it to make them more smarter. And if you do not have applications on Azure, you can actually go ahead and create those using Microsoft Azure and you can again use iot on top of it. So yes, if you talk about iot and measure it is a very good choice and a very good option that people can opt for what all can you do with iot and nausea. Let us take a look at some of the important iot components on Microsoft Azure now when I say components you can think of these as services that cater the need of Internet of things on top of azure platform. Let us try to understand those. So guys first and foremost. You have your Azure iot Central now when you talk about Microsoft Azure as I've already mentioned it is a cloud platform. So if you've learned Cloud platform to some extent you have three services you have infrastructure as a service platform as a service and software as a service. Now as you progress with these Services iaas is basically a service that provides you with basic infrastructure on top of of which you can choose everything that you want to do. That means you can basically have a basic layer on top of this you can choose what operating system you want to use what binary is to use what applications to run what programming languages to use. So it is a basic infrastructure that you can have when you talk about pass it is basically platform as a service where a platform is given to use where you have ready-to-use templatized applications. And when you talk about SAS, it is software as a service where a complete software is given to you on rent which you can use For example Gmail. I mean you do not have to set encode Gmail, right? It is a ready-to-use application. You do not worry about it. I mean its security its management its maintenance everything is taken care by someone else. So Cloud provides you with these kind of services now when you talk about Azure iot Central think of it as a SAS kind of a service I mentioned Gmail, right? So what it does is it provides you similar services or it provides your service that basically lets you create a similar software as a service kind of vacations for iot platforms. So that is what has our Central is when you talk about Azure iot accelerators. It is more of a pass kind of a service that lets you create templatized applications or templatized iot applications, which you can use to create ready to use iot Services. Now, what is the difference between these two the major differences now Azure iot is is a service that means it would require you to put in less efforts. I mean it is more. Ready to use kind of a service just like your Gmail. So it is easy to create but the disadvantage of this service is it does not give you a lot of customizations. I mean, you cannot go to Gmail and decide to hard code it again, right? You can't but when you talk about Azure iot accelerators it again provides you with templates to create applications, but it is platform as a service. That means it gives you a platform. So this platform it forms a way or paves the way on which you can actually go ahead and put in your applications besides. What kind of platform what kind of software you want to run on top of it? So it gives you more flexibility. So it would require more efforts. So it is not easier but it gives you more flexibility. So yes these both Services basically focus on templatized applications third on this list. You have Azure iot Hub. Now Azure iot Hub is a very important service. Basically what it does is it lets you connect other services and applications so it forms a central point of communication. Are all these applications. So when you talk about the first two Services, they are kind of dependent on Microsoft Azure iot Hub to some extent the other way around is not true. That means as our iot Hub is a fairly independent service what it does as I've already mentioned it lets you communicate with other applications and other services it forms that Hub where applications communicate then you have assured digital Twins and has your time series insights now these Services basically what? They do is they let you create models. Yes, they let you create models and when you talk about digital twins, yes, it works in that way. When you talk about other time series insights. Basically, if you've learned analytics, you know, you're talking about time series that means how data varies from time to time like your stock markets, right? I mean the graph is not constant. It might go up. It might come down. So basically a series of information that varies as per time is called As Time series analysis when you talk about Assad. I'm series insights. What it does is it gives you insights or lets you build applications that helps you collect real-time data and generate insights out of it. So it is an analytics kind of an application when you talk about Azure iot it helps you in data visualization and for various analytic approaches as well as your Spear and has your Maps now when you talk about has our sphere basically what it does is it lets you create devices to choose our Hardware heavy. I'm not sure whether Whether this is the right term to use now when you talk about iot also talking about Hardware devices that let you connect different sources when you talk about has your spear. It has a set of devices or classifications, which lets you do a lot of iot things like basically it has it sets of MC use our micro controlling units. Basically that helps you in better iot services. And when you talk about has your Maps, I've mentioned an application called as knowing the traffic at different locations tracking your cars and stuff like that. So For that you need the location of the device and as your Maps help you in that aspect of iot as well. So Guys, these are most of the services that Azure iot has to offer to you. We won't be getting into the details of all these services today as we move further and we have more sessions on this topic. That is a zero iot. Probably I would be focusing on all these Services individually and in a lot more detail for now. Let us just quickly move to the demo part. What I'm going to do is I'm going to quickly switch into the other. Your console and we are going to go ahead and kind of create a simple Azure iot Hub. So guys when you talk about Azure iot or when you talk about has are in general. Now, you have your Azure portal. It provides you with free Azure services for a limited amount of time. If you are completely new to Azure, I would suggest that you actually go ahead and create a free tier account. All you have to do is given certain details your credit card or debit card details and you're good to go. You can have that free tier account in which you have certain free. That means you can use these credits to use these Services. I mean, these are paid services so you can use those free credits to practice these services on your own. I would suggest that if you do not have a free tier account, you actually go ahead and create one now in my case. This is a paid account. So I am kind of restricted to using these applications. So let us just go ahead and create a simple Azure iot hub first. So as this is the console. I mean you have a number of services whether you talk about your recently created. Has whether your machine learning analytics blockchain compute containers. Now, these are different domains that has or touches Upon Our concern today is internet of things. So let's just click on this icon and go to Azure iot Hub. If you move to these different Services, you can actually go ahead and learn a lot about them. This is quick start tutorial one for iot Hub as well. So you can know what you can do with all these things are all these services. So when you talk about Microsoft Azure, there are a lot of documentation Czar a lot of dough. Events that has your provides you for free. So you can use those documents to understand these services to a lot more details. I would suggest that you actually visit their website and take a look at those Services as well. Meanwhile, I've moved to the service as you can see the subscription is a Dirac a subscription here Resource Group. I can create one or I can use the existing one. So let us create one. Azure iot demo 1 2 3 4 5 Guys. These are unique names. So probably you might be forced to give longer names. Let's just say okay. You can choose the location where you want to create this idea. When I say location, what does your does is it has a data centers in different parts of the world so you can choose the data center that is close to you or you can choose the data center that is close to your business and accordingly. You can take a call on which reason do you want your data to based on based on that you can choose. Region, there are certain services for which all regions are not available. So you would want to visit those particular services and decide accordingly in this case. I'm going to stick to West us. I mean, it's a simple application. So I do not want to put in too much effort or time into it. They just named our application as in my first iot hub It's not available is what it says. Let's say 1 3 4 4 2 2 2 1. Yep. Now it is available. So you can just review it first, right? You can go to previous. Actually, you can take a look at the size and the details you want to enterprising tear it is S1 for me. That is standard one. I won't be getting into the details of pricing Let's ignore that for now cost for month for this device is 1652 INR that is Indian rupees and it supports four hundred messages, basically. Number of units for the hub for now, let it be one you can change it accordingly and you can actually go ahead and decide whatever you want to use again. So let's just move to free tier for now so that we don't get charged a lot and it is just move ahead and say review and create. So this is the information this is the subscription - pay-as-you-go. This is the name region and the name. I just go ahead and say create. So guys creation at times might take a while not wrong, but a minute or two. So there you go. The deployment is in progress already. It is giving you all the information that you need and once it is done you can Avail information on other things as well. Also guys, if you are new to add Eureka or to our YouTube videos, I would suggest that we do a lot of stuff. I mean if we have a live sessions mostly on Tuesdays Wednesdays Thursdays, we have our forecast sessions as well. You can actually go ahead and And the visitor podcast Channel where one of our Associates he works on great sessions, then you have live sessions which I've already mentioned and there are quite a few other channels like these own medium channels on IG TV and other places as well. So a presence on social media is huge. You can stay connected to all these media to learn about new technologies. I mean, we upload content on all these platforms every day and especially we started with YouTube. So if you are looking for such content on YouTube like on regular basis, you can actually go ahead and subscribe to our YouTube channel so that you can Avail these videos like every day and also make sure that you click on the Bell icon so that you get notified to these videos on regular basis because there are a lot of resources that I believe would help you in a lot of ways I would be dropping in the links for the other channels that I mentioned in the description so that you can actually go ahead and probably sign into those channels as well like telegram these own HDTV medium Etc. As far as this application goes the process is still Underway, let us just quickly refresh it and see whether the application is created whether it's up and ready now. It's still underway. So there you go guys the resources created you can click on this icon. You can see the information is here that is you can have your operation details by clicking on this thing and you can get the details about it. You can copy the details as well. You can go to the resource as well which is here and based on this information. You can actually go ahead and decide what kind of access do you want this device to have pricing and scaling all these things can be taken care of other information that you need need a way to provision millions of devices. Go ahead and see how these things work. So guys this is how you actually go ahead and create a basic iot Hub in the following sections that follow this session. Probably we would be creating a lot more content related to these topics and I believe these topics would help you a lot more as far as this session goes guys. I probably believe this is the end of it before that. I would suggest that you actually go ahead and delete the resources that you have. You'd have to enter the name of the app that you've created. So let me just go ahead and Do that Hub? One two, three. I've given it a fairly long. And so there you go guys. The reason I'm asking you to delete these Services is now this was under the free tier, but probably there are services that would cost you a lot more and say for example, if you launch a server and keep it running so probably you would be paying a lot of money and I don't want that to happen. So I would suggest that you always follow this practice where you delete the resources that you've created and once you do that it is certain that You won't be charged. Now. You can see that if you go to this deployment the resource won't be found because I have deleted it already today. We are going to discuss Assad chat Bots. Can we create chatbots using these Cloud platforms? So, yes, we can create chatbots by using cloud computing platforms. If you talk about AWS you have a service called as legs and if you talk about easier it is as your Bot service. So this time around I thought of using a different platform and that is why I went ahead with Azure. Let's continue with the session and take a look at the agenda for today's session. As far as the session goes following at the offerings. We would start by understanding what our chat Bots next. We would understand what is observed bot service and how can you use it to create a chatbot? There's a lot more to offer as we move further everything would unfold. So, let's jump into the first topic of discussion then First we need to understand how communication has evolved at time now, if you talk about times when I was little I remember my father writing letters to his relatives are my grandparents rather. So in order to send these emails or letters we had to attach those postcards go to the Post Office put the letters there and then that Postman would take that letter to the respective party and that party would reply in the same manner. So this process would take days, isn't it? It had its own fun, but If you talk about current times, the technology has evolved a lot. And with that the way we communicate with people has changed to nowadays. We have something called as mobile phones right where if we do have to go ahead and communicate something to people all we do is we just go ahead and type in a particular message and it gets delivered to that person within seconds. That is how communication has evolved and what has this part done. Well what it has done is it has made communication one easy and two more human-like. What do I mean by more human? Like now I've been in the age of chatting as well. And I know that how do we chat? It's very simple whatever we have to say. We just type it right unlike the formalities that we do in other ways of communication say for example suppose if I have to apply for a leave. What would I do? I would go ahead and type an email right in that case. I would be putting in the details as in who it is to be sent to what is the subject then I would put in the details then I would ask for a leave and all those things. I mean this also is Pretty much organized but then it is too complex, isn't it? If you talk about chatting, it's very simple. I'm not well, I won't be coming today as simple as that. Imagine if we could just go ahead and do this in every aspect of a life. Wouldn't that be easy? Can that be done? Definitely it can be done nowadays what people are doing is they are trying to attach communication or Implement communication everywhere in such a manner that you can easily communicate with people or with different resources and get the desired result out of it. One of the ways to do it is chatbots. Let's try to understand what chat Bots are and how do they contribute to this concept? Well, if I were to Define chat, but it is nothing but a software that lets me communicate with a human now suppose. I am an individual and I have certain requirements suppose. I visit a website what happens there a pop-up comes in right saying that how can we help you? What is the possibility that it is not a bot in 90% of the cases it is so that is what a chatbot is in more formal ways. It is nothing but a bot or a software that can have a conversation with a human being. There are types of this chat bot. You have the standard chat Bots and the self-learning chatbots as well. Now if you talk about a standard chatbot think of it as a device or a software that learns not learns that takes in the data that is given to it. And if a query is thrown at this bot the machine or the software would reply to that individual. It does not go ahead and make any modification on its own. This is where the second option comes into picture. You have something called as self learning chat Bots. These are the Bots that actually taken the data understand the data and then adapt to that data in my previous session. I talked about recommender systems right for people who are completely new to the system. Let me tell you what it is. Now basically recommender systems are nothing but those are devices or software is rather that give you suggestions. Now these suggestions are given based on the inputs that you provide think of it as your YouTube channel, right? I mean where you put in a particular song and you play that song when you do play that song If you take a look at the suggestions suggestions list, you'd be having a song that either relates to the song that you played or the song that you might have played previously. So what has happened here is your so-called recommender system or the software. It has learnt from the preferences that you have given or the browsing history that you have. It also takes into consideration the preferences of other people who chose similar data and based on that it gives you an input, right? Look at these are the songs that you might like as well similar is the case with a self-learning chat bottom. What it does is given the data you provide to it it learns and it makes the discussion more interactive to give you another example suppose you are a policyholder and let's assume that there is a criteria that unless you are 18 years of age. You cannot buy a policy at that particular place now. Also imagine that you have this imaginary child or a kid who has turned 18 this year. Now if your data is with this chat Bots or with this organization a chatbot would understand what your data is and next time you try to converse with it. It might give you a suggestion saying that okay, your son recently turned 18. Would you like to buy a Polish up for policy for him as well? So that is what a self-learning chat bot. Does it basically goes ahead it understands the data and it adapts to the data and based on this adapt adaptation. It rather gives you a suggestion saying that okay, this is what Do you like to do this as well? The aim here is to go ahead and make the interaction little more interactive than what it is already. That is why the reason why this is happening is because as an individual, we like to have discussion with people that is how human beings are. We like to communicate and the aim of chat Bots are these software's is to make the conversation as interactive as possible plus the fact that we have chatbots everywhere. What companies are trying to do these days is they're trying to make They're working a lot more easier instead of just giving you information. They're trying to understand your requirements and according the give you Solutions. So you do not have to go through the documentation and all those processes. So this is what chat Bots are. Basically those are nothing but software's that try to understand the data that is given to them and based on that. They would either give you an answer or a solution to the problem that you have. Let's try to understand chatbots and the concepts that surround it a little more. So what is the need of chatbots now? I have already discussed quite a few reasons as in why do you need chatbots? But there are some other reasons as well. Most important reason is When you compare it with a human being a chatbot performs better. How is that now? There's no computation to no competition to human brain. Right? I mean, we all know that it's a great thing and it is the thing that actually created your chat Bots. But if you talk about precision and performance, if you have a software that has been trained that could actually give you a better application and better throughput. How is that? Let me give you one more scenario the next point that is easy to replicate. Do I mean by this now suppose I have a human being who is setting and answering certain queries no matter how great or how brilliant that individual is. If I throw like 20 queries parallel to him. He probably would be able to answer four to five queries, right? So this is where a chatbot is different. I mean I can train I can create one chatbot. I can program it in one way and then I can train it for 20 different services. So when 20 different queries come in, I have 20 chatbots that can actually do the job that is Needed so when you talk about parallelization, this is where chatbots come into picture. So these are some of the needs apart from that the major need is to make interactions lot more interactive than what they are. So yeah, this is what chat Bots are and we are going to go ahead and Implement chat box by using Microsoft Azure. And in that we would be using a service called as as your Bot service. So let's try to understand what Microsoft Azure is and then we can move into the demo part where I would be talking about the Bots service and how big attack bomb So what is azure well, as other is nothing but a cloud service provider now if you compare it with Amazon web services it again is a great cloud service provider just like Amazon web services and it has a plethora of services to offer to you. Whether you talk about your storage Services compute Services Security Services, whatever service it is. Everything is taken care by Microsoft Azure and what it does is it lets you create applications deploy them maintain them monitor them and also keep them. The best thing about Microsoft Azure as it is a Microsoft product. Now when you talk about Microsoft, we all know that the plethora of applications are the Microsoft stack of products. That is there. We all know that it is huge and what that means is there might be some software in your life which you are using and that has something to do with Microsoft Azure. So if you are moving to Cloud you would want to use or have the ability to move your so-called application or have the freedom to implement your applications that are there in Microsoft on Our Cloud platform, isn't it? So if you are using Microsoft Azure, it becomes easier to migrate all these applications or integrate these applications to Microsoft Azure. So it actually gives you a freedom of using your favorite tool or your Frameworks on Microsoft azure. So yeah, that is what Microsoft Azure has and as I've already mentioned it is a very popular cloud service provider. In this case. We would be using Microsoft Azure bot service in particular and using that we are going to go ahead and create a chatbot. So that is what we have for the demo part. Let's just switch into the console of Microsoft Azure and let's take the discussion forward there. So yeah, guys, let me first give you a scenario as in what are we going to do now now when I talk about creating a chatbot, what is going to happen here is first I need to create a chatbot. And in order for that chat box to work. What I'll have to do is I'll have to go ahead and create some Source or some data source from which might chatbot would learn isn't it? I mean, it needs some data, right? So for that we need to create something called as knowledge base. Now, your knowledge base is nothing but basically a set of information it can Be achieved from anywhere maybe a URL that has Pages or to where the information is given or it is a document that you own so we would be using the document or that URL and using that URL we would take in the data and we would create a knowledge base. Once the knowledge base is ready. We would go ahead and switch into Microsoft Azure portal and there we would be creating a chatbot. Now what we would be doing is would be giving that chatbot that information and then we would test our chat Bots as in whether it works. You're not once we are done with this. I'm going to take it a step further where I would be going ahead and integrating my chat bot with my Facebook Messenger app. So stay tuned and let's Implement all these things one by one first and foremost. Let's start by creating our knowledge base for that. We have to go to this URL that is skinny maker. Bear with me guys if my internet is little slow. It might take a little longer than normal. So this is what we have here. That is www.uh.edu. I now if you come here, you can create your knowledge base. If you click on this icon, it would say create a knowledge base. Okay, I have to sign in every now and then that can be rating YC sign in. No, I don't keep it signed in that is why it asks me every now and then but that way I feel it's safer. There you go might take a minute or two. Probably less than that. First it would check whether I have any knowledge bases that are there with me already. If not, it would ask me to create a new one. So that is how it works guys Microsoft Azure at times takes a little longer time to load that depends on various sources. I won't get into the details of that. So if that happens, don't worry, I would be keeping keeping you engaged and we'll be discussing something meanwhile. So, there you go. We have this thing here. I say create a knowledge base. Okay, so guys we are creating a knowledge base. Right? So since we would be putting it on Microsoft Azure, we would be needing a service that is there on the platform that can attain to this knowledge base, right? So for that we have to create a QA Service as well. So let's go ahead and create that service here if I click on this icon. It navigates me to Microsoft Azure account. Now, I've already signed in so it will directly take me to the portal and it would open that tab where we can just go ahead and create this so-called UNM occur. If you want to visit the website first or the portal first and then open this thing you can type your QA maker and it would take you to this page where you can click on Create and then this would appear so this is the Microsoft Azure dashboard. We would be talking about it. Do not worry. So we're going to go ahead and create this DNA maker service. Let's call it same. Demo, one two, three, four five one one subscription. It's Usher 533 standard. What is the payment here? I want keep it standard again. And location is West u.s. That me prefer that now you are chatbot service is not available everywhere. So you would be wanting to be careful while you select the Region's. Okay guys Resource Group. Now it by default is the name of my clinical name and it replicates the name. You can actually go ahead and use a an Research group if you have one if not, let it create one. So what is a resource Group? Basically, it is nothing but think of it as a container where certain resources are put in by Microsoft Azure. So when you do create a service along with that it has to have a resource Group attached to it. So each time you have a service either create a new Resource Group or use the one that you already have and that suits your needs in this case. We will be creating one once you do that come here and select this thing. The move one two, three, four five. Everything is okay. West u.s. Is the region West u.s. Is the reason again, so guys, everything is pretty much in line. There's nothing that we need to discuss here. Let me just go ahead and click create. Yeah, so it would just go ahead and create this thing. Once the thing is created. We can actually go back and then select this. Okay. It's deploying now. These are some of the applications that I created in the past. I do not need them right now. So I'm just going to go ahead and remove these Meanwhile my application gets created here. service started Okay, it's deploying. So as I've already mentioned at times it takes a longer while so Yep. This is what might happen your might take a minute or two or a half a minute if we are lucky enough. So once we do that, we're going to come back here select all the resources and then we are going to create a knowledge base. Now. What happens here? When you do create that knowledge base. Basically what your Microsoft Azure does as or CUNY maker does is it fetches the data from the source that we are generating or the shows that we are giving now as I've already mentioned you can either go ahead and probably given a document or you can select certain URL in this case. I'm going to go ahead and select a URL What kind of data would be like if we have some effects that would be better right? So let's go ahead and select some fa Q's. Let me just go ahead and search for us terrific use and will select the first one that is there. Now. This is an ad let's not select this. Let's select this thing. So guys this probably has some has our support fa Q's. So some questions asked and some data given. So this would be one of the best data sets to use here. So let's copy this link and as you can see that our service is created. Let me just spin it to the dashboard. So it becomes easier to use It has been pinned now I go back to CUNY maker and I refresh it cuz you need to refresh it once because else your so-called service won't be displayed here. Okay, loading your QA services. Please do that for me. Okay, so it has been refreshed now, let me select the by default account that I have my subscription name and the service which I just created URL I paste it here. And then I say create. Knowledge-based name cannot be empty. Okay. I forgot to enter in the name. Let it be the same as we've already entered it is nothing but what was the name? Okay, let's call it say let's come here first. It's demo. One, two, three, four, five one one right? So let me just given that name. I like to have it ambiguous guys at times. It's simpler to remember same names or use one name throughout the applications of ambiguity is good at times. So there you go. Let's hope it's get it gets created this time around. Okay, so might take half a minute here. And once it's done it would fetch in all the data and it would create a knowledge base which we can use now guys. Once the knowledge base is created. It would be created based on the data that we've entered but that is not how I would start the communication right instead. What I would do is I would start by saying maybe hello or how are you are something like that. So when I say hello, I need an appropriate in reply from the chatbot. Right? So we would go ahead and use this knowledge base, but we would also go ahead and add a couple of comments or a couple of Doctors or endpoints for this discussion. So there you go. The knowledge base has been created. I would like to train it a little more by adding a queue a pair or two. So in case if I just go ahead and say hi. I want my chat bot to replace something like this. Hello. how Maybe help you. There you go. So and let me add one more. Juniper this time what I'm going to do is I'm going to What just happened? Okay. There you go. Hmm. Let me just say thank you. And on this let it say. Glad we could help you. Hope to see you soon. There you go. Somehow I'm not sure whether I added that high thing. So if that is not added here probably will just use this thing to test as an if we say thank you. This is the output that we need right now if we tied some of these keywords, this is the data that should be displayed. So let's just say save and green. One pair cannot be empty. So which pair is empty right now? Okay. Is there something that is empty here? I cannot see anything. That is empty. What just happened? The problem is we added. Hi and hello, right. I just cannot see where did it go? Could not see where it go. Okay thing that some key pair is empty there is thank you here and there is a plus here. So this is fine. This is what we have. We have anything else that we need to focus on. Okay. This is the part. Let me just refresh it guys that we probably would be able to edit it better. Again, the waiting then that is something that I hit a lot when you work with these things. How to get a pet let's say hi and just say hello. How can we help? Question mark and let's see whether we can save it now. Okay. Now there shouldn't be any problem here so high and hello has been added. So I believe we can test our so-called knowledge base based on the data that we've entered here, right? Yep, it has been added successfully. So let's test it guys. I say hi and I hit the enter button. There you go. We have they play how hello. How can we help you can ask other questions as well like Do you provide support? So if it can actually go ahead and parse this data or rather segregate this data it would give you an answer. They go it has the answer. It has used the database that is there and it has given in the answer that suits in best for this keyword. So guys test is complete now. Let's just go back and publish this knowledge base. For that I would need to refresh it once and once it gets refreshed I can just go ahead and publish it. So guys once we are done publishing this thing. Okay, we have this option you'd publish. Okay, so it might take half a minute. So once it gets published now, we are going to go ahead and create a chatbot and we are going to integrate or we are going to give this knowledge base to a chatbot. So if we again taste test it and put in certain queries, it would give us the reply for the questions that we've asked so there you go. Now, this is something that we would be needing. It is nothing but sample HTTP request that means once I try to connect with my chat bot there are certain credentials that I might be required to enter like The host ID or the authorization endpoint and all those things. So let's the let this thing be open and let's just switch to the dashboard part now here I can create my chatbot for that. I need to click on create a resource. There you go. I say I plus machine learning and I get this option where I say web app bot. There you go. So let's create something called as demo. One two three, four, five six one one again subscription is a zero five three three. It has created a resource Group Central. No. No, I want vest u.s. Want West u.s. I scrolled on what is the but template. Well, it has built-in basic C sharp now click on this thing and select QA that is question and answer phone. And Isis select they go I scroll down east us again. I want West uh, maybe West years to and I say create So guys this thing takes a while. It takes a minute for my chat Bots to get created now. Once the chat bot gets created. Next job is to take this chat Bots and connect it to the knowledge base and move the whole thing to my Facebook Messenger. Now, this is where I would be asking the questions that is I would be creating an application on my Facebook messenger and on that I would be putting in this chat bots. So if I do throw in these queries my Facebook Messenger would reply that means the chatbot would reply using my face. Messenger for that we need to integrate our chat bot with the Facebook Messenger. So how do we do that for that? We need a Facebook account. While this thing works out, let's do that. Now this is a sample account that I've created. This is an anime, which I used to watch Once so I've taken this template this basically deals with different vendors who can bend different elements. Now, you don't need to get into the details of what those elements are. I've just used this theme and based on that. I would be creating a page to which I want my chatbot to react to and I would also be going ahead and creating an application as well. Why are we creating all these things once the body is ready. You would understand. All the stuff is in why we are here and what are we doing here? Meanwhile, just create a page first. Let's say create and let's call it. Say OK, let it be business brand call. It's a metalbending. Don't get into the details of what this title is It's random title and category. We are here for education. So let's stick to that. I say continue. Okay, it says I have been blocked for some reason. The thing is I happened to create this thing twice today. That is why probably they block me as in. For creating this page. Let's see if we can choose some other category and see whether they allow us to create a pager. arts and entertainment maybe now Okay, they need other details as well. So let's skip let's try something else. It's a beauty salon again, they need in the details. If I put in education that is when they don't ask anything else. Okay Education website. Let's say continue and let's hope that they let us create one. Okay. No, I have been blocked. So I doubt that I would be able to use this thing. Let me just quickly switch into some other account and see whether I can go ahead and try to do it with some other account. Let's try to create a page now. Let's hope that it lets us create a page here. Isaac create nice and creative page. Let's call it say if it allows me well and good. If not, then we'll have to switch to something else. Probably it is letting me create one. So that's a good sign. We can go ahead and use this thing. Skip and I say skip Do you guys we have a pager now? Once we have this page next what we have to do is we have to go ahead and take a look at certain other details that are needed. Like if I click on this about page, I would be having an ID here which I would be using now. This is my page ID that I would be needing. Okay, so we have a sample page and we are going to use this to test our application apart from that. I would be going to this Facebook developers where I would be going ahead and creating an application as well. Now. I am basically signed in as Vishal here. So not as good. Let me just go ahead and create one more app. Let's call it say the move for today There you go. and I see create Mi a robot. No, I'm not. submit So guys an application would be created here. Okay, so we would be using this application and we would be attaching a messenger to it and we would be attaching the chatbot to this messenger. Let me just quickly go ahead and check one more thing because I do not want any more problems in this session. So let's just quickly say Facebook. messenger if I open the messenger, let me just see what is the messenger that I have by default here. So as you can see I have this thing which I do not want I would rather go out and log out from here. So guys yeah want to continue as we shall pardon. There you go. Now we should be good to go. So, yep VI her and guys by the time our I believe our application is up and ready. Pin it to the dashboard. Now as we have an application on Facebook, we have a page on Facebook and we have our demo bot up and running which we can use. So let's just open this thing and see what it has to offer to us. Now Guys. These are the resources that we have at our disposal and apart from that. We have quite a few other things that we can do. We can test our website here. We can take a look at the analytics that is there. And what are the different channels that we can use to use this chat bot. So we are going to take a look at all these one by one but first and foremost, what I'm going to do now is I'm going to go ahead and connect the knowledge base to my chat bot. How do we do that? We come here and we click on application settings. Once I open that I would be entering the details that we have here. The connections are the endpoints. There you go. So I have to scroll down and these are the three fields that I need to enter here. So I copy this first that is now this is my ID, which I would be entering here the first place where I enter this thing is this Okay. I also need the hostname which in this case is this Okay, and apart from that we have this data. This is my authorization key. Okay, so let's just verify it. We have the Knowledge base ID which is correct host name is correct. And the authorization key is also there. So let's just save it. Yes, so it has successfully updated this thing so I can just come here and I can say test it in chat box. So if I just say hi, you should give me a reply. It's still sending the data. So okay, how can we help? So yes, it has been integrated or connected to my chat bot. Now. Next job is to connect this chat bot to my messenger app, right? So, how do we do that? To do that I would have to come here to channels and I have some channels that are made available which I can connect to first. I would just come down and select Facebook Messenger the one which I want to connect to. And as you can see, this is the reason we created the app and all those things because we need to fill in these details as well for that. I would come here. To my page and I would copy this page ID. Guys, there's too much to and fro of information here. So keep an eye on that as in what I'm copying wear. This is the page ID. As I move further I have this application here. So in that if I go to settings I have the basic settings option. I need to copy this idea as well. Now. This is my application ID, which I would be copying here. Control V and guys lastly we need the secret key, which is here. I need to copy this as well control C and I paste it here. Okay, so as we also need something called as pays access token, but that is something that would be given to us. Once we move further a tell you how to generate that as well. Do not worry. Yeah, so guys now we are at our application one small change that we need to make here as well as mean move to the advanced setting. And in that we say yes to this thing. At the bottom we have allow API access I say yes. And I saved English. There you go. Next we move to the dashboard and now we configure our Messenger to with the chat box. And how do we do that? We scroll down here on the dashboard and we select this option. Set up. Okay, so there are certain things that I need to take care of. I need a page access token as well. If I come to a preview guys. There are certain things that I would be needing to review. And before that I would be needing to enter in few details. We would be taking a look at those as well one by one do not worry about it. Okay. So when you come here first thing you do is again go back to settings. Sorry dashboard. Yeah. So what is the page that I want to refer? It is sample metalbending if I'm not wrong. Yep. It would ask me for Access. I would say yes. And I would say okay. Give access it will generate a token, which I need to copy. Once it's copied. You would come back to the dashboard of your Microsoft Azure and you paste it here. Like this and this thing is more than ready to go now. I come back here again. Okay guys, so I need an API through which I can actually communicate the messages that is through and to and fro. So how do I do that? I have something called as webhooks. I won't get into the details of it, but it helps me in better communication rather. So I would be needing to enter in these details here. These are available here on my dashboard if I scroll down I need this thing one copy. I pissed it here. copy Again, I paste it here. And these are the subscription fields that I need to respond. So I say verify and Save. There you go. Select a pager again sample metalbending subscribe. So my web hooks are done now. My next job is NLP. Sample metalbending I say yes. And add all these to submission. There are certain details that you need to enter one is as in what kind of communication would you like to have here first select the page? I see if I say hi. Give me a reply saying hello. Okay, and I just scroll down here and I say save. There you go. Next is this. For better enduring guys. Don't worry about this thing. This is just a basic input okay. Mmm. Why do I need to access apps local? better communication I say And lastly I have this thing. Okay now for better time management Maybe Okay, I see. They go guys. So this has been saved and almost everything is done and I believe you're good to go. So this information has been entered in properly before I do that. I need to set this thing live it would give me an error here. I'm sure okay, you must provide a valid policy or a URL policy in order to make your application life. How do we do that? It has to be there somewhere in the setting part. So there you go private URL policy we enter it here. Let's use sample da TV moving and I save the changes. How can I set it live? Definitely? I can set it live now. So I said set it live it would say select a domain first. Which domain do you want to Target? It's a education and I say confirm. There you go. So this is done. Let me just go back to I believe you. My app has been set life. Start a submission for approval. Yes, please select all these fields. And I say add 7 items. There you go. So this has been done guys and our app is good to go now. So I would just go ahead and save this thing. Okay, so If we just go back to the channels, we would see that our Facebook Messenger has been added. So if I do put forth a query that would be replied into my Facebook Messenger or my account would reply that is my chatbot would reply using my account. So for that okay, this refreshing takes a while at times so we should see the messenger app here. There you go. If I click on it I get this at my disposal. And if I type high this time round, I should get a reply. How can we help? Do you provide support? So there you guys we've successfully gone ahead and we've actually integrated our so-called application with our application on Facebook. That means a chatbot is replying using our Facebook application. So that is a plus and that is what I wanted you all guys to see so what we've done is we've gone ahead and created a chatbot. We've created an application on Facebook and we've combined these two so that if I can throw in queries on to my Facebook or if somebody comes in and throws in a query much chatbot would reply on that page as well. So we have Fully done that and this was the aim of the session. Today we will be comparing these three powerful Cloud platforms and see how they stack up against each other. So let's get started before we dig in here's the quick intro Amazon web services was established in year 2006 but 12 years of experience. It's the most popular player in the market. It offers wide range of services across storage compute analytics data base and many other fields and like six to seven years after AWS Usher was launched by Microsoft though its way anger. Do a WS it has quickly built a reputation for itself in the market and just like AWS, it offers complete set of cloud services. And in the same year as Microsoft Azure Google Cloud platform was launched as well. The main reason of introducing gcp was to power their own services like YouTube and Google search but later on the build Enterprise cloud services as well. So you can say that Google Cloud platform is still an evolving cloud computing platform now that we have an idea. A foundation of these Cloud providers. Let's see where the sun and terms of market share. So here's the snippet of media interpretation. And you need to keep in mind that this information is with respect to first quarter of 2018. So Amazon web services delivered a 49 percent increase in sales that is up to five point four four billion dollars then Microsoft Azure - Road increase of 17 percent that's up to seven point nine billion dollars and alphabet Google's parent company said that the division which had gcp along with The services like Google hardware and Google App Store saw a revenue growth of 36 percent. That's up to four point five billion dollars and with all this starts. I can confidently say that Amazon web services is still in the lead and holds Lion Share of market. So if I have to tell that infirm of numbers the Amazon holds 33% that's almost about one-third of the total market. Then we have Microsoft which holds about 13% and finally Google which holds about 6% So to conclude Amazon web. Services market share is bigger than x next to largest competitors combined together. Now that we know who leads the market. Let's compare these Cloud providers based on the services they offer so first, let's consider compute Services the compute services offered by all these three Cloud providers are equally powerful and yet unique in their own way Amazon's primary compute service is easy to purchase elastic Cloud compute as for the Microsoft its primary compute service is known as virtual machine. Unlike Amazon's ec2. This washing machine provides enhanced security hybrid Cloud capabilities and integrated support for Microsoft software similar to Amazon's ec2 and Microsoft Azure swatches machine Google Cloud platform offers compute engine this compute engine offers automatic price discounts and at once on an infrastructure that uses half the energy of typical data center. Well, that's about the primary compute Services. Now, let's take a look at additional. I'll compute Services. I'm sure you know that all this Cloud providers provide a combination of IRS pass and SAS services, but to say platform-as-a-service a strong suit of Microsoft. So Microsoft Azure offers a short cloud services using which you can easily deploy scale and draw in an application on flower Amazon's elastic Beanstalk and Google's Google app engine are similar to this Azure cloud services moving on. Let's say you want to deploy a virtual Private server without bothering about the underlying infrastructure. Then Amazon night sale is the best option similar to Amazon lightsail Microsoft Azure offers virtual machine engine and Google Cloud platform has yet to launch one such similar service. So all this Cloud providers also support container platform and the offer their own unique survival is Computing Services as well to conclude and turns of compute all the three Cloud providers offer equally powerful compute services and yet I say that Google Cloud platform the still lagging behind and some areas now moving on to storage Services AWS offers a long list of storage services to name some it offers simple storage service elastic block storage and elastic file storage talking about database options at offers Amazon Aurora a high-performance relational database Amazon RDS and dynamodb managed nosql database a SS also offers a cloud-based data warehouse, which we know As Amazon redshift though. It doesn't offer a backup service per se it offers Amazon Glacier for long-term archival storage at very low rates. Then talking about Microsoft Azure. It offers way more storage Services than compared to AWS and just for the basic storage it offers for options and for database it offers six to five options and like AWS. It also offers cloud-based data warehouse, which we call as your data warehouse and unlike AWS Microsoft offers. Is an actual backup service called as your backup in addition to this is your backup. It also offers site recovery and archival storage a final Contender Google Cloud platform when compared to AWS and Microsoft assured offers less number of storage services with the storage services like Cloud Spano and Cloud big table are quite popular and it doesn't offer backup or any archival storage service. So in terms of storage Amazon web services and Microsoft Azure star neck to neck whereas Google Cloud platform. Khan has still a long way to catch up with Amazon and assured all these vendors are actively launching Services aimed at cutting it Technologies like survival is Computing machine learning analytics and iot, if you talking about Amazon web services it offers Athena and quick site using which you can get Data Insights. It also offers a machine learning service called sage maker and legs using which you can build Voice and text chat Bots. And as for the iot devices it offers green gas iot messaging app. And as for Microsoft, it has invested heavily in artificial intelligence and it offers a machine learning service called ml studio and a bot service called Azure bot service and addition to this. It also offers cognitive services like Bing search API text analysis VPI computer vision API and many other services and then Google Google Cloud platform is known for its analytical background. I'm sure you might have heard of a service called Big query that enables interactive analysis of massive. Large data sets an addition to all this it also offers iot and servile is Computing Services, but still they are in beta version though. One of the major benefits of most flower providers as that competitive pricing strategies and all these three Cloud providers follow pay-as-you-go model. It means you need to pay on the basis of usage. Where an Amazon charges you on Harley basis Microsoft Azure and Google Cloud platform charge one minute basis and all. the three Cloud providers offer you on demand pricing that is the standard price you pay when you access their services and then in addition to that Amazon also offers you spot instances reserved instances and dedicated host where you're liable to get certain discounts based on some conditions then as far as your it offers special price for developers and something called as your hybrid benefit suppose your organization runs some sort of Microsoft software on its own data center then using this as your hybrid benefit you can get 40% And discount depending on the type of Microsoft software you use it and as for Google, it offers customer-friendly pricing compared to Azure and Amazon web services, it offers different type of discounts to name some you have sustained use discount these type of discounts usually kick in automatically when you keep using same instance for most part of the month, then you have preemptible instances, which is similar to Amazon spot instances. And one more thing is that all these three Cloud providers offer your long-term discounts. So if I After conclude Google Cloud platform as almost always the lowest class provider. Then you have a sure the second least expensive and it's prices are usually close to armazones. And if you are looking for long-term discounts as an Amazon web services is the best option the big takeaway here is that you won't know which vendors least expensive until you know, what you need with this Cloud providers. So now that we have looked at the features and pricing. Let's see which one of this Cloud providers are easy to get started with so any guesses Well, if you're guessing atps, it's right here Blaze provides this nice and easy page to start using the services. You can see that the break it down by platform you want to work on. So whether you're making an IOS app or writing in PHP the provide you some sample code so that you can easily get started and as for Microsoft Azure and Google Cloud platform, the segregation of services here is not that great when compared to AWS. That's mostly because they are less experienced. So you need some getting used to before you feel comfortable to start using the services. So there you go guys. We have compare all these Cloud providers based on their market share features pricing and implementation to conclude Amazon web services Still Remains to be the most popular cloud provider. Mostly because of the seven years Head Start, it has over its competitors and aw services are far more evolved and functionally Richmond compared to other services. It has its weak points as well. It doesn't support hybrid Cloud strategy and its counterpart Microsoft Azure though it was On several years after AWS. It's doing fairly well in the market it has its form foundation and is actively competing against Amazon web services. You shouldn't be surprised if it overtakes Amazon web services in near future and then our final Contender Google Cloud platform when compared to AWS and Microsoft Azure Estelle, not that popular but it's known for its pricing strategies and machine learning and article tools at offers. But other than that, it has a long way to meet up Amazon web services and Azure, so guys every cloud computing platform. Form has its ups and downs, but the best cloud computing platform or the one that's suitable for you. Julie depends on what you expect from these Cloud providers or what kind of services you need from these Cloud providers in these Cloud providers are what kind of services you need from these Cloud providers today. I'm going to give you top 10 reasons as to why one should go ahead and then Microsoft Azure, so let's not waste any time and quickly get started. The first reason on my list is security now when you talk about cloud service providers people normally have the doubts whether these platforms are secure enough or not. But Microsoft Azure puts all these debates to rest. It uses something called a security development lifecycle this ensures Security even from the operations perspective and also from the customers perspective. Plus they have more than 50 compliance programs, which ensure that all these stringent policies are implemented and they're thoroughly taken care of. So if you're worried about security do not Microsoft Azure will definitely take care of all your security concerns integration since people want to move the data to Cloud. We would be talking about a lot of applications and when you talk about a lot of applications you need to be able to integrate these applications with your service provider. That is why you need to have good integration. And apis what Microsoft Azure does is it first of all provides you with dotnet integration. Now, we all know that dotnet is a very popular language and if you are able Incorporate or use microsoft.net with Microsoft Azure, it would be a big plus and Microsoft Azure exactly. Does that apart from that? If you do want to go ahead and use other applications or maybe other Technologies you are free to do that as well because it has something called as API management which ensures integration or collaboration of various applications with Microsoft Azure. So again integration is something that can be done very easily by using Microsoft azure. Analytics and machine learning now when you talk about analytics or machine learning, you know that you would be dealing with huge amount of data. Now in that case you need databases that can deal with both SQL kind of queries and nosql kind of queries that means both structured and unstructured data Microsoft Azure makes arrangements for these type of queries and databases as well. It also supports blocks another service and various other algorithms like your machine learning algorithms artificial intelligence algorithms and a lot of things that you can do in machine learning and data. And basically now we all know that these Technologies and terms are very popular in recent times and they are here to stay and Microsoft Azure will ensure that it takes care of all these Technologies and approaches as well of Ops. This is another approach which is very popular. What it does is it brings in developers and operators together when you talk about software development now, it has various phases and these two teams play a very important role in it, and they normally have a conflict. Because they share similar interests, but they deal in different environments. What devops does is it brings these two teams together and that ensures Breezy development and it also ensures fine-tuning of various applications Microsoft Azure also incorporates this approach. So if you are interested in develops, Microsoft Azure will let you do that as well. Sixth on this list is hybrid capabilities or in simple words customization. You need to have a platform. It is highly consistent because you are talking about different applications coming together Microsoft Azure provides with that kind of a platform. Plus it also ensures high level of connectivity. It uses something called a CD and that is content delivery networks and vpns on these things ensure static moment of data and applications. And that is a very healthy point to have when you're talking about hybridization or customization of your applications. First on this list. We have pass offerings pass stands for Um as a service what Microsoft Azure does is it provides you with a platform where you can easily set up your applications. That means you can build them. You can manage them. You can monitor them and also take care of all the security issues as well and also all these things happen at a very low cost that means your cost to set up is very less forth on this list. We have learning curve if you wish to incorporate a particular technology or a service provider, it should be easy to learn and that is the case. Microsoft Azure, it is fairly easy to pick up and understand plus we have a lot of documentation. Zand study groups that let you go ahead and learn Microsoft azure. The next point on this list is scalability. This is often the problem with cloud services. The reason why Cloud came into existence was it wanted to overtake or overcome this problem of scalability because it was difficult to pre decide how many servers or space you are going to use. So people move to cloud and Microsoft Azure definitely takes care of this issue because it enables granular scaling and it lets you scale up and down as per your need. This makes the system very flexible and easy to make changes that is if you want to have a completely So in this application you can do that as well. Cost efficiency now. This is a very important point because when you talk about money people normally tend to look at businesses where they can save a lot of money and yet end up making a lot more money than what they've invested Microsoft Azure ensures that you use a model called as pay-as-you-go. That means you would be paying only for those services that you use and only for the time duration you are using them plus you can also go ahead and keep track of all the costs and the money that you would be investing or you have already invested. That means you have ready to use Which tell you as an if you use these services for this longer period of time you would be charged this much so you can keep a perfect track of how much money you would be investing or you are using right now. So if cost-efficiency something that is there in your mind Microsoft Azure will definitely make sure that you pay very less money. The final few now when I was jotting these points down. I realized that I had more than 10 points. So I just went ahead and jotted few points for my last point. So well as on-demand, I believe I just discussed this point that means while you create your applications, you would not want to get into a phase where you have to deal with your servers or at least maintain or monitor them what Microsoft Azure does is it maintains your servers and software is for you so you can focus on your business problems and create applications independently, so it is truly serve well as on demand Container services now, this is nothing but an approach again this lets you have containerization or rather virtualization at the operating system level which ensures that you can go ahead and build your applications with much more ease. Now there is a containerization technique called as communities and what Microsoft Azure does is it lets you use coupon at ease that means you can simplify your process of building applications again identity provider. This is an important Point as well. Now when you're talking about a lot of applications, you will have to go ahead and sign in for every application identity provider what it does is it lets you have a single sign so you do not have to worry about going Iden signing in again and again and this brings us to the last point that is application monitoring since you are dealing with so many applications again, you want to be in a situation where you have all the metrics or all the data that is moving around and you would want to keep a track of all these data what application monitoring does is it provides you with a feature called as Insight management which gives you a matrix at a single click and you can have all the information that you want to have so these Some of the points I feel which are very important and I felt that these were the top points that I wanted to discuss with you people. If you people do have any different suggestions or you feel that there are certain other points, which are more important than these we can definitely share those points in the comment section below. We will talk about few as your interview questions. So first of all, we need to understand what exactly is your is and what's the reason behind us understanding and talking about these interview questions. So as you're as pretty hot topic these days it's a part of Microsoft cloud lot of people who are listening to this particular webcast would have been heard of might have heard of AWS. Is that when we talk about Google cloud is that this one from Microsoft which we are talking about There's a huge potential as far as cloud is concerned and the market is huge. The market is hot these days and I will share a few of my experiences as far as the interview is concerned and the questions relevant to a zero. So if you talk about this particular interview session, I mean the question and answer session, I would say rather or interview. So this covers two major courses in Azure one is 5:33 and one is so 534. So 533 is for admins and 5:30. For is for Architects. So when you talk about admins the people who are responsible for managing and doing the run and maintain every day one is your so the questions on this particular slide would focus on that and at the same time few things related to the architecting part, right? So there is another course also from Microsoft itself, which is why 32, we will not focus much in 532 because that talks about I would say programming. So how do you use as your I would Services in order to put here Services, I would say your applications one is your so that basically focuses on that so we would not talk much in terms of that. So this will again focus on five 33 and 34. So let's just start with the interview questions. So now when you talk about cloud computing lot of different people have different definitions of cloud computing. So now of cloud computing is something which is not very new technology. I would say, I mean the terminology is new, but the Elegy is not the first product I would say which was talking about Cloud was my Hotmail which was designed and developed by subbing party. So I'm sure a lot of people listening to this webinar would be aware of that particular name. So what he did was he design a mail server? So in that particular mail server, I used to provide an access my nails, right? So that means server was in the cloud and then I was connecting to that mail server remotely to access my mail. So that makes the cloud product right? So now when you talk about Cloud computing these days the definition has changed but as far as the working is concerned at it remains pretty much the same. So now when you talk about this we talk about that we use and pay right so paper uses the kind of more what we talked about. So we basically use and then pay only for that amount of I would not say data, but I would say Services which we use so there's explanation down there in the slide. It talks about it is the use of servers on the internet to store manage and process. Yes data difference is instead of using your own servers. You're using somebody else's server to do the task and pay them for the amount of time for which you use them. Right? So this is what the idea is. So paper uses the model which we focus on when we talk about cloud computing these days, right? So this is what club is this is what a basic definition of cloud is if you search the internet you will have more than is a hundred hundred plus definitions on cloud. Now as far as definition sunflower a concern It's up to you which one you would like to adapt and which one you would like to go when but then it works with a single model which is paper use. So when you use you pay if you don't hear you don't pay and end of day using somebody elses resources. No, you're not using your own resources and you're only paying for their resources what you use? Okay now talking about different type of services which we talked about as far as my flower is concerned. So there are three major things what we talked about. It is isps and SAS and the other things like somebody has talked about días database-as-a-service. Then you talk about SES so that is for my mails, but then majorly we categorize these into three types one is isps and SAS. So I asked talks about infrastructure as a service and you get the hardware in that from the cloud provider as a service. So say for example, you want to go ahead and deploy a machine deploy a server. So basically when you talk about that particular scenario, you are basically putting a server in IAS, which is my infrastructure as a service. So you get complete control on a virtual machine, which is there in the cloud hosted by Microsoft Google or AWS. And then you can just go ahead and pour in your resources on to that particular machine. So this is how it works right simple enough. Then you talk about Pas platform as a service. So in this you don't get access to your machine or in other Words, you can say you don't get access to the underlying layer, but you get complete access to the resources or the services, right? So it's more like my platform on which you publish your applications or you put your application. There are few examples. So I talked about my web apps my mobile apps which are in is your then talk about the last type of service offered in Cloud. So this is my SAS. So when you talk about SAS you get software as a service and as you're so you don't need to About infrastructure. You don't need to worry about platform. So you basically are getting the end product which may be running on the infrastructure which may be running on the platform. So for example, when you launch a VM on as your if you talk about OS you're not buying the OS and if you talk about PS, you're not buying the service. So you just basically paying for the software which is running on either is or either way. Yes. So this is what we get as far as my types of cloud is strand now, let's just jump onto another question. Now, what are the different Cloud deployment models? So explanation talks about three models, which we have one is my public Cloud one is my private cloud and why is my hybrid Cloud? So let's just take this with examples. So I am a general user. I'm a home user. I want go ahead and put a website. So I decide that my website will be hosted on my cloud, right so I won't go ahead and deploy a VM on the cloud and I won't put my Website over that so I go to Microsoft website as your website, I sign up that and then I maybe you can see provision of machine. Once I provision of machine I put is on top of it once I put is on top of it. I will just go ahead and move my resources when I say move my resources more my application in the cloud. So what I'm trying to say is General basic end user who's sitting at home can log into the cloud get a machine and then use a machine, right? So this is what my public cloud is, so it's available for the public, right? Then you talk about the private Cloud as far as private cloud is concerned. It's owned by the Enterprise. Okay, and only Enterprise people will have access to it. So organizations like Accenture, or maybe we approve or maybe capgemini cognizant. So these people own a private Cloud, right? So the idea is that the resources are owned by them and hence their people are the ones who will go ahead and access that but then at times what happens is they give access to their private Cloud for Their customers also now you might have question that why do I build the private flower because end of day I'm spending a lot of money on infrastructure. I'm spending a lot of money on air conditioning electricity and I'm spending a lot of money on licensing also, so why can't I just go ahead and work on public Cloud. Why do I need to go ahead and Implement a private Cloud now, basically when you talk about a private Cloud private cloud is built for automation. So that is one of the most important things and the second important part one we talked about Is that when you talk about private Cloud it gives me more control over the resources. Whereas when you talk about public Cloud. I do not have control over the resources because everything is owned by the vendor right now talking about hybrid clouds. So I'll give you an example for this. Also, I go to Amazon and Amazon is my public cloud provider and I tell them that I need a private Cloud. So would it be possible for you host a private Cloud for me. So Amazon says yes, and they dedicate a list of resources for me. Lie for me only for my organization. So now we need to talk about Amazon Amazon is hosting a public Cloud but then they also are capable enough of hosting a private Cloud for my organization. So that makes it a hybrid Crown. So this is what hybrid Cloud means. So these are three different ways of how I categorize these Cloud models now fear the questions now the question says I have some private servers on my premises. Also I have distributed some of My workloads on the public Cloud. What is the architecture called when you talk about this kind of scenario? So we talked about my virtual private Network. So these are my query options basically virtual private Network. Then we talk about private cloud and we talked about my virtual private cloud and then you have hybrid Cloud. Okay again, so just read the question carefully and then probably I'll just jump onto the next slide and we will talk about the answer and the explanation. So again, I would say I have some private servers on my Mice has also have distributed some of my workloads on the public Cloud vertices this architecture called. Okay, so now it says hybrid Cloud. So when you talk about this this type of architecture would be on a hybrid Cloud why because we use both public cloud and the on-premise server, which is on the private realm. Let's just jump onto the next question. So we have a few General SEO questions now, these are as your space. Terrific the questions which we did talk about previously. You are just general Cloud questions, right? So if you are giving an interview for maybe a day, or maybe aw, so maybe Google so those four questions are something which you I would say go with any of these scenarios any of the interview which you would do. Okay. Now, these are specific General is your question. So when I say specific generalize your questions, so we talked about only as urine. Okay. So the first question talks about What is Microsoft Azure and why is it used? Okay, so as I initially said that is your is my public Cloud prolongation. So let's just see how it works. So we have a definition on the next slide. Okay, so as discussed above the companies which provide cloud services or clock called Cloud providers, and of course, I did explain you this in the previous slide. I mean the first slide which we talked about. So I explain you about Google so that is a cloud provider I explained to you about aw a star as a cloud provider. Wider and then I talked about Israel, which is a cloud provider. So now is your s from Microsoft and the idea behind this is it's more like my public Cloud so you can go to a zero you can log onto is you create a machine and then start working on that. So this is one of the cloud providers so Microsoft is one of the cloud providers one of the major Cloud providers these days, right? So this is what my is your is now talking about with services and SEO is used to manage resources and energy or so. We Few options. I have my application in sight I have my here in which is my is your resource manager. Then you have my is your portrait then you have my log and let X. Okay. So as far as this is concerned so we talked about my ERM. So this is a service which is basically on the newer coated right? So now when you talk about these Services, which is on the new portrait, so it is used to manage the infrastructure which involves a number of is your senses. It's basically my fabric, so I'm not sure how many people Are aware of what is energy or fabric? But then the idea behind this is that when you talk about my is your fabric as your fabric now runs on something called are a previously in version 1 of is your it was using the service management model. So now this is a new thing right? So when you talk about managing the resources and is 0 so we basically talked about resource manager model and then how Services run it how they work and how they interact with each other. There are lot of things which you need to work on and what you need to learn. As far as my Adam is but for the time being you just need to remember that we talked about my as your resource manager, so this is something which runs everything and takes care of lot of different things. As far as measure is concerned. So when Aaron came lot of different game a lot of different things started coming in so tag was one of them resource groups was another one. So if you have are familiar with Resource Group great, if you familiar with tags, great, if you're not just go to Google and search for it and you'll find your answer. Sirs, okay, then you have few questions, which of the following web applications can be deployed with is zero. Okay, so we can of course put asp.net applications in his ear now. You might have a question where exactly I can use these applications or where exactly I can deploy the applications. So to answer that you can deploy it either an ISO. You can deploy it either in paas, right so you can of course deploy asp.net you can deploy PHP. You can deploy WCF The answer is all of the above, but then it's very important for you to understand that if there is an application which is on Java so that may have few problems when you deploy it on is you're right because of course as your is majorly designed for Microsoft Services. Okay. Now when you talk about these Microsoft Services Java is not a Microsoft product. So it's more like it's not that friendly when you compare it with other services, which we are running in the cloud, okay? Specific to Microsoft cloud, of course, I would say Okay jumping on to the next one then few other questions. So these are my fill in the blanks a - role is a virtual machine instance running Microsoft IIs web services that can accept and respond to https or HTTP request. Okay. So we have four options in here one is my web one is my server one is my worker and one is my client. Okay. Now when you talk about this the answer to that is A patrol is something which is basically posted on a virtual machine and is running on Microsoft II's web server and that is capable of accepting HTTP and https requests. So basically on the web roll, what you do is you can upload your website and your website runs on top of it and then of course, you know that my website works on HTTP and https. So hence my web goal is the one which is capable enough of running that particular maybe application or software or web services. Has okay the other question what we talk about is what is the use of roles in Microsoft Azure? So when you talk about what is the use of Rose we talked about three rules one is my web roll one is my worker role and one is my BMW. Okay. So now when you talk about my web roll web roll basically is for hosting and deploying my websites. Okay, the worker rule is the one which basically helps the web rule to execute the background processes the example I can give you is my Jobs, I'm not sure how many people are aware of their jobs. But if you want to can again search on the internet, so my web rule is reciting one worker role worker role is the one which supports my web role and the worker rule is the one which actually resides on my VM bro. Okay. So this is the one which talks to the underlying layer. It's more like a framework it acts as a framework. So that means on the operating system. I have my worker role on top of it. I have my web roll. So my web browser is the one which will host fine. Services I would not say services but the applications rather. Okay. So jumping onto the next one. Now. The question says is it possible to create virtual machines using a CRM in a virtual Network that was created using classic deployment. And of course, I don't think so. It's possible. So let's just see this is not supported as I said because ERM is something different and previously the classic pokeballs using a different model of a deployment. So it used my classic Model of deploy. Which was basically for service management and if you see if you're aware of the two portraits, you will see there's a huge difference in how classic poker was and how the new vocalist so there's a huge difference in terms of that also. So it's not possible jumping onto the next question. What a virtual machines skill sets so scaling up scaling down. So if you're not aware if I have more number of requests coming in my virtual machines have the capacity and capability to scale up and scale Down based upon. Schedule and performance. Okay. So in other words what I can say is if my CPU is spiking 200% or not hundred percent I would cap it to 9. So if my CPU is spiking 290 and my requests are still coming in for accessing that portal the web portal. Maybe you can say which is drawing on this particular machine. So my skill set is intelligent enough to scale one more instance and then load balance the traffic between the two instances which are now deployed running the same set of our Kitchen, okay. So this is what my skill set. Does it automatically Auto scales. I would say rather the workloads right based upon the performance and the schedule now how the schedule thing works. So say for example, if starting from morning 9:00 to evening 9 you have more number of visitors on the website so you can scale more number of instances for your website and after 9 p.m. At night, you can minimize the number of instances right? So this is how my skillset works. Okay, jumping onto next question our dinner disappointed with in skill set. So now first of all when we talk about this, yes, of course, my data discs are supported in scales and okay. So when you talk about this a skill set can be defined as attached data disk configuration that applies to all we have Sandy said so there are few types of data disc examples, which are given over there. So one is of course my is your files which is my SMB share disk. And then you have my OS drives. Then you have my temp drives then you have my SEO data. Also slightly blogs are there and tables are there and cubes are there and then you have my external data services such as remote databases. So all of these are supported all of the discs are support which you see over there talking about availability set. So do skill sets work with is your availability set. Now. First of all, you need to understand what is an availability set availability set is basically grouping of servers so that I can load balance information among those servers. So that is done for high availability. And there is something called fault domain and update domain as far as high workability is concerned. So Faldo means say is that if I have two VMS in same availability set both the VMS will share the common power source and common Network. Okay, as far as update domain is concerned. So update domain talks about that if I have a say for example 10 vm's and I would keep the value of obtain domain to 2, so I will have sex of to to each right so I'll have a group of to to eat. Right and at a given point in time if Microsoft needs to perform a planned maintenance only one update domain will go down argument for it. So this is what my optic nerve endings. So now doesn't support my availability set the scale set supports my availability set. Yes, the skillset supports my availability set and you can just go ahead and fetch some information about the availability said if you're not very much well versed with variability sets as far as my answer is concerned. Okay, and there is a small description also. So with that so I'll just read that for you. Yes, the skill set is an implicit availability set with five fault domains and 5 update domains. Okay skill sets of more than a hundred VM span multiple placement groups, which are equivalent to multiple availability sets Okay. So this is what it means and then I would just skip the other part because I've given you enough explanation for this and I would definitely recommend that you read availability set. Okay. Now the question is what is a break fix. Shoom break fix issue is a technical problem, which is like your environment as running and then all of us are no problem comes right that is a break and then fixing that particular problem as my fix, right? So technical problems are called break fix issues. It is the industry term which refers to work involved in supporting a technology when it fails in the normal course of function, which requires intervention by a support organization to restore the service. Okay, so this is what quick fixes Now it's not specific to is you're actually it's just a common term what we use as far as my services are concerned. So even if I talk about on-prem on-premise Network, so we still talk about brick fixations, right? So, I'm not sure how many people have got a chance to call Microsoft and open a support case in case you have issues with any of the things in your environment. So those issues are basically my right fix issues jumping onto next question. Why is azure active directory? Just okay. Now when you talk about is your active directory active directory is used for identity and access management. First of all, and it's a Pass based service is your active directory is a fast-paced service now, it is used to Grant access to employees to specific products and services in your network. So there are a lot of examples salesforce.com Twitter, right? I can give you a few more examples office365 into which are two different products for Microsoft. So they work with Azure active directory right now as RAB has some in build support for applications in the gallery which can be added directly. Okay, so there is a gallery and then you can just go ahead and add support for Azure active directory to any application which is available in the gallery. Okay talking about few other questions regarding SEO really what happens when you exhaust the maximum failed attempts for authenticating yourself via is your EB? Okay. So we have a more sophisticated strategy to account lockout which is based on IP. The request at the password enter. Okay. So now when you talk about on-prem we talk about account lockups. So if you enter incorrect passwords more than three times, so your account is logged out and it will be unlocked after maybe 15 minutes or half an hour or one hour based upon how your administrator has configured it. Now the same thing happens in as your ad but then it happens based upon the IP address. Okay, so it will go ahead and track the IP address of the requests and the password. I entered and the duration of the lockout also increases based upon the likelihood that is in the attack. Okay. So this is how it works when we talk about maximum failed attempts for authenticating yourself. Okay, jumping onto the next question. Where can I find a list of applications that are pre-integrated with is your ad and their capabilities? So when you talk about this my eyes you're a lie has around 2600 pre-integrated applications and all pre-integrated applications. For single sign-on single sign-on, let's your organization credentials to access your apps some of the applications also Spore automated provisioning and de-provisioning. So there's a gallery you can just go to the gallery and then you can give list of applications which are available for using my is Yuri. But of course that is not the complete list of applications which are available which you can use as far as this is concerned. There are huge number of applications which are supported by 0eb. Okay. For single sign-on is one of the components of Israeli. So probably in case you're not aware of single sign-on, you can just go ahead and do some research on that now talking about the next question. How can I use applications with is your ad that I am using on premise? Of course, you can do that. Now my is already gives you an easy and secure way to connect to the web app that you choose you can access these applications in a way you can access your sass faced applications and as your ad so you don't need to Have a VPN installed. Okay, then just go ahead and install a component and then you are ready to go. You can use the applications which are there on premise few examples I can give you is you can use your SharePoint. You can use your web apps for which the servers are installed on your premises and you would like to use as your ad for authentication. So Tim do that for sure. Now the question important question very important question. What is this is your fabric service fabric. So when you talk about that my is your service. Fabric is a distributed system platform that makes it easy to package deploy and manage scalable and reliable microservices. Okay. So this is the II which actually controls your network your storage and your compute. Okay, which are basically the most critical components of my cloud. So if my fabric will not be running in the back end so nobody will be assigning IP addresses. Nobody will be assigning resources and nobody will be These storage. Okay. So this is the guy which actually runs everything I would say in the cloud infrastructure, right? Okay. Let's go further service fabric also addresses the significant challenges in developing and managing Cloud applications developers and administrators can avoid complex infrastructure problems and focus on implementing mission-critical demanding workloads that are scalable reliable and manageable. Now, my service fabric represents the Next Generation middleware platform for building and managing these sighs class p.m. One cloud-based application. Okay. Now what is V net we net is basically nothing but my virtual Network so we night is a representation of your own network in the cloud it logically isolates your instances launched in the cloud from rest of the resources, which you have in the cloud. So this is my whole network based on which my configuration of machines depend on me the subnets the address space depends on right talking about feel things. What are the differences between subscription administrator and directory administrator? So when you talk about the subscription administrator, the subscription administrator is the one which is responsible for the complete subscription by default. Only one subscription administrator role is assigned in Azure subscription administrator can either be a Microsoft account or either can be your work account. And that guy has control over the complete Azure portal and the services which run on them. Okay, if you want you can just go ahead and sign up more accounts which are basically subscription administrator. And these people are my co admins now as far as the Azure ad is concerned. So the account which we set up over there for identity and access management. So we talked about my 0dd administrator the directory administrator. So let's just read this as your Ada has a different set of admin rules to manage the directory and identity related features. These admins will have access to various features and as your portrait All the is your classic portal and the admin roles determine what they can do like create or edit users assign administrative roles to others and so on. So this is what my eyes you're a lie administrators. Are there any scale limits for customers using managed disk manage disk eliminates the limit associated with storage accounts. Now first of all, you need to understand. What is the manage disk? Right when you create a machine now these days you will have an option over there that you want to use manage risk or unmanaged. Yes. Right. So when you select manage bisque Microsoft manages, I would not say Microsoft but then the air is your fabric manages all your desk, right? So a disc which is assigned to VM will be managed by a zero. Okay. So this is what my manage this is now using my manage disk. I basically eliminate the limit associated with my storage account. However, the number of manage diskpart subscription is limited to 2,000 by default. Okay, so you can have two thousand manage desk in Azure subscription now talk. But what's the difference between service bus cues and storage cubes. Now, the Azure storage Q is simple and the developer experience is quite good. It uses the local Azure storage emulator and debugging is made quite easy. The tool for Azure storage Cube allows you to easily peek at the top 32 messages. And if the messages are in XML or Json will be able to visualize their content directly with the visual studio furthermore. These cues can be purged of their content which is especially especially useful during the development process the queue efforts basically and as far as my service buses concern, so the has your service bus cubes are evolved and surrounded by many useful mechanisms that make it Enterprise worthy. They're built into service pass and are able to forward messages to other cues and topics and they have built-in header message queue and messages that are time to live that has control hence messages don't automatically disappear after 70s. So if you talk about This probably will have to go ahead and read about what is a service mask you and my storage cues. So I talked about my storage views which are a part of my storage itself. If you're not aware of Storage storage has four types of storage one is my blog one is my files one is my cues and one is my tables, right? So you need to have more information of what my storage Q's is okay now talking about what is is your reddish cash. So that is an open-source in-memory data structure store used as as a database and then you talk about cash and a message poker. So when you talk about my is zero radius cash that is based on the popular open source redis cash. It gives you access to secure dedicated redis cash managed by Microsoft and accessible from any application with an SEO. It supports data structures such as trains hashes list sets sorted sets with a big range of queries bitmaps hyper logs and indexes with radius. It is okay. Another question we talk about is why does not Microsoft writers cash have an MSD in class Library reference like some of the other is your services now, of course when you talk about this, this is an Open Source One, very important thing now. My Microsoft red is Cash is based on the popular open source Riders cash and can be accessed ssible by a wide range of reddest lines. And that is the reason we cannot just go ahead and pour it into msdn. Okay, so simple enough Just remember that because each client is different. There is not one centralized class reference on msdn. So we cannot just restrict it. Maybe you can see right. So this is the reason we do not have any MSD in class library for my that is Cash. What is my red is databases? So red is database are just a logical separation of data within some relish instances. The cache memory is shared between all the databases and actual memory consumption depends on The key value stored in the database. For example, a C6 cash has 53 GB of memory and you can choose to put all 53 GB into one database or you can split into multiple set of databases. Then you have another question. Why was Mike line disconnected from the cash? Okay. Now when you talk about this the following are some common reasons for cash disconnect now my client side causes the client. Education was redeployed the client application performed a scaling operation in the case of cloud services or web apps. This may be due to Auto scaling the networking layer of the client-side changed. Then you have transient errors occurred in the client or in the network node because of the client and the server the bandwidth threshold limits were reached cpu-bound operations took more long to complete and then you have my server side issues. Also, if you have the server side issues also on the stand cash offering there is It is cache service initiates a failover from the primary note to the second reload. Now as your was patching the instances where the cash flows deployed and this can be the radius server updates or Journal be a maintenance then you have what is does your search so simple enough is your search is a cloud search as a service solution that delegates server and infrastructure management to Microsoft leaving you with a ready-to-use service that can populate with all your data and then use to add search to your Or the mobile application so it works with rest API or dotnet sdks. Of course, the other questions my web app still uses an old Docker container image and I have updated the image on Docker Hub, which is basically the new portal what we talked about. So we are basically talking about container services. Do you support continuous integration deployment of custom containers. Now, first of all for private registries, you can refresh the container by stopping and starting the web app. You can change or add a dummy application setting to a force and refresh of your container. So this is what you can do now talking about feel things. What are the expected values for startup file section and I can figure the runtime stack now for Jess knows you specify a p.m. To configuration file or your script file for dotnet code specify your compiled LL name for Ruby. You can specify the Ruby script that you want to initialize with your app. Okay, how your is your Marketplace subscription is priced. So we have these models one is monthly fee. So pay-as-you-go kind of thing usage-based. Then you have free software. So Microsoft gives you a free subscription. So free subscription is valid for a period of one month and you get approximately $200 in that so you can use that then you have the free. So this is for the customers who are not charged Marketplace fee for use of the offerings. Soft offerings and you have by1 bring your own license. Okay. So these are the subscription models basically how these are priced you can say so jumping onto the next one. What is the difference between price software price total price in the cost structure for virtual machine offerings in virtual machine. So let's just see price refers to the cost of azure virtual machine to run the software software price refers to the publisher software running on the virtual machine total price refers to the combined cost of these two simple enough. I don't think so. You need to get more details of this because it's very simple price of VM software price total price don't price is equal to price of VM plus software price. Now, the other question talks about what our stateful and stateless microservices for service fabric. So service fabric enables you to build applications that consists of Microsoft's so stateless micro services such as protocol Gateway and web proxy do not maintain. Just ate outside a request and its response from the service. Now my is your cloud service worker role is an example of a stateless service and my stateful micro services such as user accounts databases devices shopping carts and Hughes maintain a mutual authoritative State beyond the request and its response. So this is how it works. Now. What is an application partition? Okay. Now when you talk about the application partition the application partition Are a part of active directory system and having said so they are directory partitions which are replicated to domain controllers. So usually domain controllers that are included in process or directory partition holder replica of the directory partition. Now, maybe you can read some more information. My domain controller has four types of partition one is configuration one is schema. One is my domain partition and then you have my application partition. So all the information related to the application goes in Application partition so it actually again has nothing to do with the cloud but then it's always good to know because if you're designing and developing an application on the cloud, you can just go ahead and put that information in the application partition on the active directory server, but then it's very important for you to understand that we should have an active directory server up and running fine in the club. Okay. So these were few of the questions what we talked about as far as my interview questions. Are so first and foremost, I would start by talking about different job trends that are there in the current market if you talk about Cloud engineering but also discuss certain parameters that affect a cloud Engineers salary, then we would get into the details of job descriptions that are there in the market that different companies require in order to hire a cloud engineer moving further. I would also talk about what skills you should possess and how should you actually go ahead and see? Your resume in order to apply for certain companies having said that guys let's just move further and take a look at some of the job Trends now guys, what I've done is I've actually gone I'd and jotted down certain figures for job vacancies in us and in India, which tell the number as an okay. These are the vacancies. Now. These numbers are specific to indeed which is a popular job portal the quite a few other portals. So this number might not be consistent it might vary but as far as India is concerned. These are the numbers and these are the vacancies. So guys now these are certain factors here. I would like to lay stress on quite a few other pointers as well to do that. What I've done is recently I've written an article on this particular topic which talks about Job Trends and salaries in particular. So I would like to refer that blog and walk you through that block so that we can discuss some of these pointers in little more detail. So let me just quickly switch to the block part. So yeah guys, this is the article that I have written recently if you take a look at it, there are certain factors. Yet now zip recruiter. They gave a number of or the average salary of a cloud engineer and they state that it is in the range of some 104 k21 45k dollars. Now that is a huge amount of to talk about US Dollars and even if you talk about the salary in India now the fact that I'm recording this session from India, I believe I should give the number in Indian rupees as well and the currency states that are the figures state that the amount is somewhere in the range of 15 to 20 lakhs for Or a mid-level ranged experienced person even for a fresher. The amount is fairly high, but it actually depends on the skill set that you have having said that it also states that is zip recruiter that it goes as high as somewhere around 250 K US Dollars, which is a very big number right? And if you can actually go ahead and pick up right amount of skills. You would be getting a high amount of salaries. All I can see having said that lets just move further and take a look at some of the other trends that are there in the market. Now. This is another interesting image, which is given by tick-tock. Now they have put in certain stats in front of you. Now, if you take a look at it, they say that the average salary in u.s. Is somewhere around a hundred and fifteen thousand. No guys this number might vary depending upon the number of data you take in because different people refer to different websites and they pick up data from different sources. So based on that data set this number might vary a little as I've already told you. It is somewhere in the range of a hundred and five 245 K US Dollars again, if you put in or taking data from other sources that might vary a little but it is more or less what this salary that you can expect. Another important Point here is that you can expect a lot of growth rate in cloud computing in recent or in near future. If you take a look at it, it says that it's 121 percent growth rate for job postings Between Two thousand thirteen to Seventeen. So these are the number of job postings that are there in the current market are these are the numbers that have actually taken a rise in recent times and guys this number is going to rise why take a look at the number of global spend. These companies are doing these days minute. About cloud computing in particular 2017. It was somewhere around 150 3.5 billion then it moved to One Eighty six point four billion and by 2021. It is expected to go somewhere on 302 which is almost the double that you had in 2017 guys. So the fact or this fact in particular states that companies are ready to invest in this particular domain and that means they would be requiring people who have skills in this particular domain and hence the need for this kind of a road. So if you talk about Job Trends salary The cloud computing is something that is booming in it is going to Boom in your future as well. So you can expect good pay scale. You can expect good kind of life. If you talk about a career in this particular domain this one more fact here guys. These are some of the skills that employers normally demand a lot as you can see python is something that is trending if you talk about programming languages, everybody knows how important python is because it's making news everywhere people even claim that it has Dethrone Java. I do not know whether it's true or not. I don't get into those. He bit the reason people are claiming that as because it has actually changed the way programming happens these days and that is why the popularity and one more factor that I would like to State here is if you take a look at its predecessor not predecessor, but the one that follows before python in this chart it is a wh it says 50% or 58% of people normally demand the skill in the market. So yes, you can Gauge by it doesn't how popular database has become at as a popular Cloud platform. So the fact that Aw is goes. Well with all the programming languages or all the tools that follow in this chart we can make sure that or you can assume how popular AWS our Cloud platform has become. So again this that states that if you try to make a career in this domain it is going to be a good option for you or it's going to be a bliss for you is all I can say, let's move for the guys and take a look at some of the other factors as well. Now, let's jump into the salary part which follows our pattern in the agenda which I discussed so when you About different parameters that affect salary one of them is what are the companies that are trying to hire Cloud engineers? And what is the salary they're offering now as we take a look at some of the numbers here Resolute Technologies VMware Amazon Accenture Microsoft. These are popular companies guys, and on an average, they're paying you somewhere around 170 160 thousand US Dollars, which is a huge amount. And again, if you ask me about the companies that are going to hire for cloud engineering almost all the major companies that deal with Computing or data processing they are going to switch to cloud in near future companies like GE General electricals. They've actually gone ahead and move to Cloud already which is a big company and quite a few other companies. Now, if you talk about Amazon we talk about Google Microsoft. They themselves are marketing cloud computing. They have their own service providers that actually act as vendors in providing these Cloud Computing Services. So yes major companies are going to move to cloud and they're going to hire you as a cloud engineer having said that let's take Look at some of the other factors that concern a salary of a cloud engineer now guys, if you take a look at salary is based on the job roles. Now, these are the three major job roles. That is a Solutions architect a devops engineer and a systems engineer. And these are the average salaries. I do not agree with these numbers that much numbers can be deceiving at times. Probably Solutions architect is one of the most demanded Cloud jobs. I mean it is the most popular Cloud certification no matter what when do you talk about Solutions architect is something that people people demand a lot. So these are some of the job roles now apart from these job Rose. There are various other job roles as well. But more or less they follow this particular category are these three categories as we move further we would be talking about these job roles. Do not worry about that. But these are some of the numbers I want you to take a note of again guys based on the location your salary might vary and these are some of the positive numbers that are there again, I've used indeed as a source here if I'm not wrong because most of the data that I have picked from it is a combination of indeed paste. And a couple of other websites that are popular going to talk about Job Trends. So yes, when you talk about indeed, these are the numbers that they've given as in based on these states or the location in USA. These are the salaries of its people can claim on an average you have numbers for India as well. Now these are three of the major states that recruit. I know Delhi is one more state, but their numbers are similar to Maharashtra mostly so yep, you can take that into consideration as well. And I'm sorry there is not a straight city, which is popularly hires. Is a lot of Engineers as well really good cow in that domain or in that region in particular the salaries are similar to what you get for Maharashtra guys. So you have these are the three states that the website shows numbers for guys and not which is the ID Hub of India. You can see the salary goes as high as this this is the average salary Maharashtra in particular. This is what which is very closely followed or follows very closely to Karnataka Tamil Nadu to has a lot of requirements for cloud engineers. And as I've already mentioned if you go to the deli part of the And yes, they're two people are looking for these skills as well. It's not that the other parts of the country are not looking for people with these skills is just that these are the major hubs and they come into their Reckoning when you talk about the stats or the data. There are other regions and States where people are normally hiring Cloud Engineers there as well. I constantly go through or do market research a lot when you talk about Cloud Engineering in particular and yes, I've seen requirements in other states as well again Guys. These are the number of job vacancies, which you saw in the presentation. So guys, yes, these are Are certain numbers that are there? And again the numbers are based on indeed guys. If you take a look at the other websites as well, you might find more numbers. So again, this is just a parameter guys. And Beyond is there are a lot more vacancies than what these numbers State the problem here is people are not skilled enough to actually go ahead and get these jobs. So yes, if you are rightly skilled definitely these jobs would be yours salaries based on experience again, you can see mid-level has the most number of salaries guys. Why is that because cloud Mostly is a branch where you would be expected to have certain skills that you've learnt while you worked. So an experience of three to four years is the best place or the best time for you to move to Cloud even two years is what I would say, it's not that pressure should not move into this role they can but again the number of placements that happen for freshers is lesser. Why because the chances of them getting picked as a cloud engineer mostly happens through campuses. I would be talking about this Factor as well. Do not worry. Once we talked about the resume part. I would help you even if you are an entry level person. When a mid-level or midscale person or a senior person at be talking about these pointers? I'm just stating certain numbers here. So entry level people normally find it a little difficult. The most expected part is mid-level. Why because salary something that companies can bargain on and these people are rightly skilled senior level two people hire these people but what happens is since you are very experienced. You normally would be expecting manner gel kind of positions, right? So you cannot have too many manager positions. So it is understandable. That number is not that high but considering that As well 180 on an average is a good number. So Guys these were some of the parameters I wanted to talk about salaries and certain job Trends. I hope I've discussed enough. So guys, let's just move further and switch to the presentation part where I would be discussing certain other pointers that concern proud engineer. So guys, let's just move further and talk about Cloud engineer skills and also the job description now guys, I've actually Club two topics from the agenda here and I would be actually going to and forth while discussing these pointers because I feel they are are very intellect or very connected to each other. So let's talk about these pointers first and foremost. Let's talk about certain skill requirements. If you want to become a cloud engineer, what are the stars that you should know now guys for people who have experienced. You probably might know some of these pointers already but I am wanting to take everyone on this similar page and while doing that I would be talking it from the very basic part as well. So let's get started with the basics first doesn't what are the skills or knowledge set that you have in order to becoming a cloud engineer. So you need to have an understanding. Why do you need cloud computing? And what are the different domains that impact cloud computing because based on that you would be able to decide as an okay. What do you want to do with cloud computing? It is a very vast domain and it has various services that are there or that are made available to you using which you can do so many things you can focus on marketing proper software development architectural part for that. You need to understand. Why do you need cloud computing? What are the different domains that it effects? And once you do that probably you would be in a better state to decide. How do you want to Use cloud computing for your own benefit moving further. You would also be required to have knowledge about different cloud service models as in these are something that tell you, how can you use your applications or how can you build your applications using cloud computing? That is why understanding of this topic is important. You need to have an understanding of different deployment models which again is similar to or related to cloud service models as well. It is the way cloud services are provided to you by your Cloud vendor that is where understanding of different deployment models is also important. You should understand why You need to move to cloud computing and why is it different from an on-premise architecture or an infrastructure rather? Finally, you need to have an understanding of different cloud service providers or vendors in the market because having an understanding and thorough knowledge of at least one cloud service provider is very important in guys when I say a cloud service provider, it is very important to understand that there are various in the market, but preferably people normally start with AWS and they gradually move to Azure which are two of the most popular. Cloud service providers. So what are the Computing fundamentals that you need to have now as a cloud engineer guys, I won't lie to you. I won't say that you don't need any prior programming experience or anything like that as a cloud engineer guys, you need to have understanding of computing fundamentals and it is very important in becoming a good Cloud engineer. What should you know networking is very important guys now it is not that much into programming but understanding of computing it starts with networking. You need to understand how routing Works what are different network protocols? Are different networking layers Etc. And how do you use networking for an organization? Because it is very important. You would be talking about a lot of applications lot of data a lot of scalability application building and stuff like that. So for that networking becomes very important computer security guys. Now when you talk about Cloud the first question people ask is it secure most of the people do not know what cloud computing does or how it ensures security. Let me give you a fact they use shared security model what it is that I won't be getting into the details. Details, but you and your Cloud vendor you actually go ahead and decide certain security principles and those are implemented. So if you are working on a cloud platform and if you are into the security part, you need to ensure quite a few things as in how to make your application secure. What are the protocols that you should fall and stuff like that and for that you need knowledge about access policies encryption Etc. Understanding of systems is very important guys where you need to know, what are the different design principles. What kind of methodology are you using? And where do you get the knowledge for these things your computer? You need to have an understanding of databases. You need to learn SQL which is very important because you are going to deal with a lot of data and guys since you're talking about Cloud platform you would be dealing with different kinds of instances or virtual environments. And for that understanding of Linux fundamentals is very important. So these are some of the basics guys which you should understand and I would suggest that if you are completely new to cloud computing focus on these pointers, As well. So these are some of the basic skills that you needed to have. Now. Let's just go ahead and take a look at certain job roles and based on those job roles. What are the skills that you should pick up guys now again, these are the responsibilities that even major companies would be expecting from you. So when I said I would be talking about job description. Now, these are certain roles and the pointers that I'm going to talk about the responsibilities. Those are the skill sets that major companies expect from you when you actually do go ahead and try to apply for Engineering jobs. So first and foremost, we have and Cloud architect Cloud developer and an admin sis Ops. Admin is nothing but system operations administrator. So guys, let's try to talk about these roles in detail guys. I won't be getting into the definition part. I would be sticking to what I've experienced real time when you talk about Cloud engineering so my definitions are going to be very general and Spacek so that everybody can understand. So if you talk about a cloud architect, these are the people who are responsible for drawing the blueprint. I mean, they actually Actually design your application as in this is how it looks so their part is designing planning stuff. Like okay when I actually go ahead and build an application. This is how much I might be expected to probably scale or these are the current software's or these are the current programming languages that I would be needing. They also take into consideration when it comes to migrating your application which already exists on premise so they need to understand what are the parameters that affect the current application on premises and based on that decide as you know. These are the changes that we need to make when we move this application to Cloud. So this is what a cloud engineer does. They actually help you design a flow for application to actually go ahead and work on cloud. Let us move further and take a look at some of the common responsibility. Is that a cloud engineer or a cloud architect is actually responsible for the actually responsible for Designing and deploying dynamically scalable available fault tolerant and reliable applications something I talked about while going through the definition part. They actually design and deploy. Applications now these are some of the pointers that concern an application like how available it is how easily can scale how fault-tolerant it is. Let's not get into the details of that. I'm sure nobody wants to get into the details of that. You should be able to select an appropriate cloud service to design and deploy applications. I mean you would be dealing with different Cloud vendors so you should know okay, if I have real-time data, what kind of an application do I use if it's static what kind of application do I use so having an understanding of these things is also very important. Are an architect again, I talked about migration. What are the factors they need to consider while migrating an application to Cloud again. You are expected to design and deploy enterprise-wide scalable operations. Now again, it sounds similar to the point which I discussed right? But again, you also need to have an understanding of operations that are performed while your application is working. Now. This is something that is important when you talk about the deployment process and dealing with the customers part because based on that our operations team has to put in certain inputs and it is designed properly at the beginning your workload gets reduced here. So this is where Cloud architect again comes into picture Implement cost control strategies to ensure maximum cost optimization money is something that is very important. And if your planner applications properly as an OK in case of using a particular kind of a service if I use the other one what it be cost effective. This is the decision again, your Cloud architect should be able to take okay moving further. We have the cloud developer. Now we have already designed our Application with the help of an architect next is building an application. Who does that your developer? So they need to have strong understanding of programming apart from that. Let's move further and take a look at some of the pointers as in what are the other things they need to be concerned with expertise in at least one high level programming language. I'm sure it's more than one. But yeah, you should know the basic programming fundamentals so that you can understand how the coding works skills for developing deploying and debugging Cloud applications. API CLI is decays. It is very important guys. Because you would be integrating a lot of applications and for that understanding of how application protocol interfaces work is very important. Now command-line interfaces are something that you would be working on with a lot as well. So having an understanding of those also helps application lifecycle management, which is very important ability to use continuous integration and pipelines for deployment. Now, this is something both developers and the admins to so you need to have an understanding of how these pipelines are created how they work and how do you deploy your data continues? You should have the knowledge or the understanding of key features of service providers guys because again, if you're building an application on cloud guys, you should know how these service providers work because you would be using a particular service to go ahead and actually build a particular part of your application. So an understanding of different cloud service providers is very important. You should be able to code and also make sure that you are thorough with the security essentials skills in writing and correcting and debugging code again, testing and building. Eating is something that goes parallely surveillance applications cloud computing supports serverless Computing and that is where you should know what surveillance applications are and how should you use containers containers or something that are trending in the market and you need to have an understanding of those as well. If you take a look at the resumes or the job descriptions in the market people expect you to have understanding of different service providers understanding of different apis at least one programming language and they have this thing mentioned as a knowledge in Cuba Nettie is or That would be an add-on. So that means they consider these skills as well. Then we have the admin guys now our application has been designed and it has been developed now it needs to be maintained by someone or monitored by someone who better than an administrator so their job is to actually go out and make so that the application runs perfectly in the production environment. What do they do? They need to have an experience as a system admin and they should be able to understand how virtualization Works something which is very important for scaling your In in case of peak times Monitor and auditor applications again have understanding of networking, which is very core for an admin role and to translate architectural requirements because they are the ones who take care of it in the production atmosphere or the environment. This should be able to actually go ahead and control the data flow because again, if something goes Rock somewhere that is doing the process of see ICD, they should be able to detect that and get in touch with the developers team as well appropriate service based. They should also have the knowledge of see Already if something goes down. How should they actually go ahead and take care of it again optimization is something that is not the concern to a greater extent as far as the Architects are concerned administrators have lesser responsibility in it. Okay. Networking is something that has repeated I believe but yeah, we've discussed that already and migration is something they are also concerned with because I've already talked about the fact that they deal with the production environment. So Guys, these are some of the responsibilities that different Cloud Engineers take care of and these are some of the responsibilities that companies would be be expecting you to be skilled in so these are some of the pointers I wanted to talk about that is about the job description and the roles and responsibilities of cloud engineer having said that as far as this particular session goes guys, I would be resting it here in here. Thank you. Bye. I hope you have enjoyed listening to this video. Please be kind enough to like it and you can comment any of your doubts and queries and we will reply them at the earliest do look out for more videos in our playlist And subscribe to Edureka channel to learn more. Happy learning