{"id":53904,"date":"2020-10-23T12:10:00","date_gmt":"2021-02-09T14:41:26","guid":{"rendered":"https:\/\/www.globallogic.com\/ua\/insights\/blogs\/%d1%88%d0%bb%d1%8f%d1%85-%d0%b4%d0%be-bigdata-%d1%87%d0%b0%d1%81%d1%82%d0%b8%d0%bd%d0%b0-%d0%b4%d1%80%d1%83%d0%b3%d0%b0-%d0%b4%d0%be%d1%81%d0%b2%d1%96%d0%b4-globallogic\/"},"modified":"2025-01-31T05:17:17","modified_gmt":"2025-01-31T05:17:17","slug":"road-to-bigdata-part-two","status":"publish","type":"insightsection","link":"https:\/\/www.globallogic.com\/ua\/insights\/blogs\/road-to-bigdata-part-two\/","title":{"rendered":"\u0428\u043b\u044f\u0445 \u0434\u043e BigData. \u0427\u0430\u0441\u0442\u0438\u043d\u0430 \u0434\u0440\u0443\u0433\u0430: \u0434\u043e\u0441\u0432\u0456\u0434 GlobalLogic"},"content":{"rendered":"<div class=\"classic_editor_content\">\n<p style=\"text-align: right;\"><em><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Author: Oleksandr Fedirko, Solution Architect, Trainer, GlobalLogic Ukraine<\/span><\/span><\/em><\/p>\n<p align=\"justify\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Last time, we looked at the ways that exist for those who want to join the BigData community and become a big data enthusiast. In this column, we will delve deeper into the GlobalLogic team\u2019s experience: we will talk about our projects and <\/span><\/span><a href=\"https:\/\/www.globallogic.com\/ua\/about\/news\/big-data-procamp-kyiv\/\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">GL BigData ProCamp<\/span><\/span><\/a><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\"> courses .<\/span><\/span><\/p>\n<div class=\"img_container\">\n<p class=\"imgyoutube\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-48739 size-full\" src=\"https:\/\/www.globallogic.com\/ua\/wp-content\/uploads\/sites\/6\/2020\/10\/site-2.png\" alt=\"\" width=\"500\" height=\"329\" srcset=\"https:\/\/www.globallogic.com\/ua\/wp-content\/uploads\/sites\/6\/2020\/10\/site-2.png 500w, https:\/\/www.globallogic.com\/ua\/wp-content\/uploads\/sites\/6\/2020\/10\/site-2-300x197.png 300w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/p>\n<\/div>\n<h5><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">How is GL BigData ProCamp different from online courses?<\/span><\/span><\/h5>\n<p align=\"justify\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">The most valuable thing about <\/span><\/span><a href=\"https:\/\/www.globallogic.com\/ua\/about\/news\/big-data-procamp-kyiv\/\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">GL ProCamp<\/span><\/span><\/a><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\"> is, of course, the opportunity to communicate with expert practitioners, get a lot of life hacks, and learn about best practices used in real projects.<\/span><\/span><\/p>\n<p align=\"justify\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">GlobalLogic has clients in various areas: marketing, sales, robotics, financial institutions, automotive, IoT. On projects, we build platforms for data analysis and collaborate with other technology areas (DevOps, Embedded, Data Science, QA) to create quality solutions.<\/span><\/span><\/p>\n<p><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">I will give a few examples:<\/span><\/span><\/p>\n<ul>\n<li><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">One of the marketing projects solves the problem of MTA (Multi Touch Attribution), which combines online advertising with offline purchases in stores. This allows large companies producing products for supermarkets to better plan their advertising campaigns and understand which advertising has the greatest impact on the consumer&#8217;s final decision.<\/span><\/span><\/li>\n<li><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Another example: every time you visit any website, an ad appears on it. <\/span><\/span><a href=\"https:\/\/www.globallogic.com\/ua\/insights\/blogs\/globallogic-raspberry-kit-how-it-work\/\" target=\"_blank\" rel=\"noopener\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">How does this<\/span><\/span><\/a><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\"> happen? How does the website know which ad to show? Immediately after you arrive on the website, within a very short period of time (10\u201320 ms), bidding takes place for the right to display an ad unit. Bidding takes place on Ad Exchange platforms. One such platform is being developed by GlobalLogic engineers.<\/span><\/span><\/li>\n<li><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Another example. The project focused on data processing in the context of security. The client has a developed infrastructure, approximately 50,000 devices (personal computers, <\/span><\/span><a href=\"https:\/\/www.globallogic.com\/ua\/insights\/blogs\/routers-and-wi-fi-part-three\/\" target=\"_blank\" rel=\"noopener\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">routers<\/span><\/span><\/a><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\"> , servers, etc.). The task was to develop a system that would be able to detect cyber threats in real time and notify operators about them. One of the main challenges was that the system had to process up to 1,000,000 events per second. The entire infrastructure was deployed in Google Cloud and had auto-scaling capabilities.<\/span><\/span><\/li>\n<li><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Perhaps the most innovative projects in the context of big data are those related to the Internet of Things: smart devices produce a large amount of data. For example, in one project, GlobalLogic engineers support an analytical platform that collects information from 750,000 devices across the United States for more than 1,000,000 customers. The information is collected, aggregated, and based on this analysis, end users are provided with recommendations for improving their health.<\/span><\/span><\/li>\n<\/ul>\n<h5><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">What kind of background do you need to start studying BigData? Is it possible to join the team after completing GL BigData ProCamp?<\/span><\/span><\/h5>\n<p align=\"justify\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">The entry requirements for this course are quite low. If you know Python or any other programming language, that&#8217;s enough. However, remember that after each course, it&#8217;s worth consolidating your skills. So find yourself a pet project. Any opportunity to apply the skills and knowledge from the courses to practical problems will help you master them.<\/span><\/span><\/p>\n<p align=\"justify\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">If you have completed our course and have a good rating and feedback from <\/span><\/span><a href=\"https:\/\/www.globallogic.com\/ua\/about\/news\/big-data-procamp-kyiv\/\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">GL BigData ProCamp<\/span><\/span><\/a><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\"> trainers , you will receive an offer to try yourself in the position and project that best suits your profile.<\/span><\/span><\/p>\n<h5><strong><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">What are the requirements for BigData engineers at GlobalLogic?<\/span><\/span><\/strong><\/h5>\n<div class=\"img_container\">\n<p class=\"imgyoutube\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-48736 size-large\" src=\"https:\/\/www.globallogic.com\/ua\/wp-content\/uploads\/sites\/6\/2020\/10\/Frame-24-1024x501.png\" alt=\"\" width=\"604\" height=\"296\" srcset=\"https:\/\/www.globallogic.com\/ua\/wp-content\/uploads\/sites\/6\/2020\/10\/Frame-24-1024x501.png 1024w, https:\/\/www.globallogic.com\/ua\/wp-content\/uploads\/sites\/6\/2020\/10\/Frame-24-300x147.png 300w, https:\/\/www.globallogic.com\/ua\/wp-content\/uploads\/sites\/6\/2020\/10\/Frame-24-768x376.png 768w, https:\/\/www.globallogic.com\/ua\/wp-content\/uploads\/sites\/6\/2020\/10\/Frame-24-1536x752.png 1536w, https:\/\/www.globallogic.com\/ua\/wp-content\/uploads\/sites\/6\/2020\/10\/Frame-24.png 1920w\" sizes=\"auto, (max-width: 604px) 100vw, 604px\" \/><\/p>\n<\/div>\n<p align=\"justify\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Knowledge of SQL is critical as one of the main tools for analyzing and manipulating data. Spark is used in most projects, so knowledge of this framework is very relevant.<\/span><\/span><\/p>\n<p><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Competence in the following areas is also required:<\/span><\/span><\/p>\n<ul>\n<li>Spark job performance optimization.<\/li>\n<li><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Distributed computing in general and data warehouse design.<\/span><\/span><\/li>\n<li><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Quality software implementation, such as <\/span><\/span><a href=\"https:\/\/www.globallogic.com\/ua\/insights\/blogs\/ci-cd-for-js-devs-theory\/\" target=\"_blank\" rel=\"noopener\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">CI\/CD<\/span><\/span><\/a><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\"> : what it is and how an engineer deals with it.<\/span><\/span><\/li>\n<li><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Orchestration of ETL processes.<\/span><\/span><\/li>\n<li><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Basic questions about stream data processing.<\/span><\/span><\/li>\n<li><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">Working with different types of data storage, such as columnar storage\/document oriented\/key-value\/graph.<\/span><\/span><\/li>\n<\/ul>\n<p align=\"justify\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">In conclusion, the demand for BigData engineers is constantly growing. So, no matter what you do \u2014 Java developer, QA engineer, or DevOps \u2014 the ability to work with big data will beneficially expand your profile as a specialist and significantly increase your competitiveness in the market.<\/span><\/span><\/p>\n<p align=\"justify\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">For example, if you are an Embedded engineer, then BigData is one of the promising ways to expand your specialization, because IoT is closely related to the collection, processing and storage of data from devices. So don&#8217;t hesitate, discover the world of BigData for yourself today &#8211; register for <\/span><\/span><a href=\"https:\/\/fb.me\/e\/h9hEcQzDx\" target=\"_blank\" rel=\"external nofollow\" target=\"_blank\" noreferrer\"><span style=\"vertical-align: inherit;\"><span style=\"vertical-align: inherit;\">GL BigData ProCamp!<\/span><\/span><\/a><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>\u041f\u0440\u043e\u0434\u043e\u0432\u0436\u0443\u0454\u043c\u043e \u0440\u043e\u0437\u0431\u0438\u0440\u0430\u0442\u0438\u0441\u044c \u0437 BigData: \u043f\u0440\u043e\u0454\u043a\u0442\u0438, \u043a\u0443\u0440\u0441\u0438 \u0442\u0430 \u0430\u043a\u0442\u0443\u0430\u043b\u044c\u043d\u0456 \u0442\u0435\u043c\u0438<\/p>\n","protected":false},"author":12,"featured_media":48767,"parent":0,"menu_order":0,"template":"","insight":[41],"insight-subcats":[807,808],"insight-industry":[791],"insight-services":[],"insight-partners":[],"class_list":["post-53904","insightsection","type-insightsection","status-publish","has-post-thumbnail","hentry","insight-blogs","insight-subcats-analytics","insight-subcats-data-engineering","insight-industry-cross-industry"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/insightsection\/53904","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/insightsection"}],"about":[{"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/types\/insightsection"}],"author":[{"embeddable":true,"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/users\/12"}],"version-history":[{"count":2,"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/insightsection\/53904\/revisions"}],"predecessor-version":[{"id":102905,"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/insightsection\/53904\/revisions\/102905"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/media\/48767"}],"wp:attachment":[{"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/media?parent=53904"}],"wp:term":[{"taxonomy":"insight","embeddable":true,"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/insight?post=53904"},{"taxonomy":"insight-subcats","embeddable":true,"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/insight-subcats?post=53904"},{"taxonomy":"insight-industry","embeddable":true,"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/insight-industry?post=53904"},{"taxonomy":"insight-services","embeddable":true,"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/insight-services?post=53904"},{"taxonomy":"insight-partners","embeddable":true,"href":"https:\/\/www.globallogic.com\/ua\/wp-json\/wp\/v2\/insight-partners?post=53904"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}