WafaStudies
WafaStudies
  • 497
  • 12 669 852
19. Prepare and Transform data in Lakehouse using Spark | #microsoftfabric #microsoft #azure
In this video, I discussed about preparing and transforming data in Lakehouse using spark notebook.
Link for PySpark Playlist:
ua-cam.com/video/6MaZoOgJa84/v-deo.html
Link to Microsoft Fabric Playlist:
ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html
Link for PySpark Real Time Scenarios Playlist:
ua-cam.com/video/fa4oQu--tHg/v-deo.html
Link for Azure Synapse Analytics Playlist:
ua-cam.com/video/Qoatg-SPpe4/v-deo.html
Link to Azure Synapse Real Time scenarios Playlist:
ua-cam.com/play/PLMWaZteqtEaKxRIiTtO7kSKpGVZq2H9uO.html
Link for Azure Data bricks Play list:
ua-cam.com/video/bO7Xad1gOFQ/v-deo.html
Link for Azure Functions Play list:
ua-cam.com/video/eS5GJkI69Qg/v-deo.html
Link for Azure Basics Play list:
ua-cam.com/video/76RqLfkypUg/v-deo.html
Link for Azure Data factory Play list:
ua-cam.com/video/Mc9JAra8WZU/v-deo.html
Link for Azure Data Factory Real time Scenarios
ua-cam.com/video/WR6AbQ3grMU/v-deo.html
Link for Azure Logic Apps playlist
ua-cam.com/video/KxkiE2JC0RU/v-deo.html
#azure #microsoft #wafastudies #fabric #msfabric #microsoftfabric #azuredatafactory #azuresynapse #azuresynapseanalytics #kusto #adx #azuredataexplorer #powerbi #pbi
Переглядів: 464

Відео

18. Ingest data into Lakehouse using Copy Activity | #microsoft #azure #fabric #microsoftfabric
Переглядів 32623 години тому
In this video, i discussed about ingesting data into Lakehouse using copy activity. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/video/Qoatg-SPp...
17. Build Lakehouse in Microsoft Fabric | #microsoft #microsoftfabric #fabric #azure
Переглядів 565День тому
In this video, I discussed about building lake house by ingesting sample file. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/video/Qoatg-SPpe4/v-...
16. Navigate Lake House Explorer in Microsoft Fabric | #microsoftfabric #fabric #azure #microsoft
Переглядів 1,2 тис.Місяць тому
In this video, I discussed about navigating the lake house explorer in Microsoft fabric Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/video/Qoatg...
What is Lakehouse in Microsoft Fabric | #microsoftfabric #azure #lakehouse #delta #microsoft
Переглядів 1,1 тис.Місяць тому
In this video, I discussed about what is lake house in Microsoft fabric and how to delete it. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/video...
1. Delete Resource Groups in Azure using PowerShell | #azure #powershell #azurepowershell
Переглядів 335Місяць тому
In this video, I discussed about deleting resource groups in azure subscription using powershell. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/v...
What is .NET | Install & Get Started with .NET in VS Code| Refer Package in .NET | #vscode #dotnet
Переглядів 568Місяць тому
In this video, I discussed about what is dotnet? How to Install Dotnet? How to install VS code? Get Started with dotnet in VS code and install nuget packages in dotnet app. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa...
3. Create Azure Windows VM using PowerShell | #azure #microsoft #powershell #powershellscripting
Переглядів 462Місяць тому
In this video, I discussed about creating Azure Windows VM using PowerShell. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/video/Qoatg-SPpe4/v-de...
Get Started with Azure Bicep and Deploy Azure Resource with Bicep | #azurebicep #bicep #azure
Переглядів 675Місяць тому
In this video, I discussed about how to get started with bicep and creating bicep file to deploy azure resource. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlis...
2. Create Azure Resource Group using PowerShell | #powershell #microsoft #azure #azurepowershell
Переглядів 4372 місяці тому
In this video, I discussed about creating azure resource group using azure powershell. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/video/Qoatg-...
1. Install Azure PowerShell in Windows | #powershell #azure #microsoft #windows #scripting
Переглядів 7862 місяці тому
In this video, I discussed about What is Azure PowerShell and how to install it in windows OS. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/vide...
6. Error Handling in PowerShell | Try, Catch, Finally in PowerShell | #powershell #microsoft #azure
Переглядів 5352 місяці тому
In this video, I discussed about error handling in PowerShell using try, catch and finally block. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/v...
5. If, Else If, Else in PowerShell | #powershell #scripting #microsoft #azure #powershellscripting
Переглядів 4702 місяці тому
In this video, I discussed about If, ElseIf, Else constructs in powershell and how they help in flow control. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ...
4. Variables and Parameters in PowerShell | #microsoft #powershell #azure #automation #scripting
Переглядів 7333 місяці тому
In this video, I discussed about variables and Parameters in PowerShell. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam.com/video/Qoatg-SPpe4/v-deo.ht...
3. Write your first PowerShell Code | #powershell #powershellscripting #microsoft #azure
Переглядів 1,2 тис.3 місяці тому
In this video, I discussed about writing first powershell code. Inputting value to powershell program. Link for PySpark Playlist: ua-cam.com/video/6MaZoOgJa84/v-deo.html Link to Microsoft Fabric Playlist: ua-cam.com/play/PLMWaZteqtEaLm10IKzSzwJ5JyOFPj0ZcU.html Link for PySpark Real Time Scenarios Playlist: ua-cam.com/video/fa4oQu tHg/v-deo.html Link for Azure Synapse Analytics Playlist: ua-cam....
14. Connect to OneLake using Azure Synapse Analytics | #microsoft #azure #microsoftfabric #fabric
Переглядів 1,8 тис.3 місяці тому
14. Connect to OneLake using Azure Synapse Analytics | #microsoft #azure #microsoftfabric #fabric
ADF & Synapse Live Recorded Course with Live Q&A | #azure #adf #synapseanalytics #datafactory
Переглядів 2,2 тис.4 місяці тому
ADF & Synapse Live Recorded Course with Live Q&A | #azure #adf #synapseanalytics #datafactory
13. Use Python to Manage OneLake in Fabric | #microsoft #azure #microsoftfabric #fabric #onelake
Переглядів 2,1 тис.4 місяці тому
13. Use Python to Manage OneLake in Fabric | #microsoft #azure #microsoftfabric #fabric #onelake
2. Windows PowerShell Applications | #powershell #microsoft #powershellscripting
Переглядів 9074 місяці тому
2. Windows PowerShell Applications | #powershell #microsoft #powershellscripting
12. Create ADLS gen2 shortcut in Fabric | #microsoft #microsoftfabric #adlsgen2 #azure #shortcut
Переглядів 2,2 тис.4 місяці тому
12. Create ADLS gen2 shortcut in Fabric | #microsoft #microsoftfabric #adlsgen2 #azure #shortcut
1. Introduction to PowerShell | #powershell #microsoft #azure
Переглядів 2,4 тис.4 місяці тому
1. Introduction to PowerShell | #powershell #microsoft #azure
11. Access shortcuts in Spark Notebook in Fabric | #microsoft #microsoftfabric #onelake #azure
Переглядів 1,8 тис.4 місяці тому
11. Access shortcuts in Spark Notebook in Fabric | #microsoft #microsoftfabric #onelake #azure
10. Create shortcut for Lakehouse in Microsoft Fabric | #microsoft #microsoftfabric #azure #onelake
Переглядів 2,1 тис.5 місяців тому
10. Create shortcut for Lakehouse in Microsoft Fabric | #microsoft #microsoftfabric #azure #onelake
9. What are shortcuts in Fabric? #fabric #microsoft #microsoftfabric #azure #azuresynapse
Переглядів 2,2 тис.5 місяців тому
9. What are shortcuts in Fabric? #fabric #microsoft #microsoftfabric #azure #azuresynapse
8. Bring your data to OneLake with Lakehouse in Fabric | #microsoftfabric #onelake #lakehouse
Переглядів 3 тис.5 місяців тому
8. Bring your data to OneLake with Lakehouse in Fabric | #microsoftfabric #onelake #lakehouse
1. Azure Get Access Token for Service Principle using REST API | #azure #restapis #microsoft
Переглядів 5 тис.5 місяців тому
1. Azure Get Access Token for Service Principle using REST API | #azure #restapis #microsoft
7. OneLake file explorer to access Fabric data | #microsoft #microsoftfabric #onelake #azure #adf
Переглядів 2,8 тис.5 місяців тому
7. OneLake file explorer to access Fabric data | #microsoft #microsoftfabric #onelake #azure #adf
6. What is OneLake in Microsoft Fabric | #microsoft #microsoftfabric #azure #azuresynapse #fabric
Переглядів 4,1 тис.5 місяців тому
6. What is OneLake in Microsoft Fabric | #microsoft #microsoftfabric #azure #azuresynapse #fabric
5. Microsoft Fabric - Roles in Workspace & Grant access to user for it #microsoftfabric #microsoft
Переглядів 3,6 тис.5 місяців тому
5. Microsoft Fabric - Roles in Workspace & Grant access to user for it #microsoftfabric #microsoft
4. Create a Workspace in Microsoft Fabric | #microsoftfabric #microsoft #azure #dataengineering #adf
Переглядів 4 тис.5 місяців тому
4. Create a Workspace in Microsoft Fabric | #microsoftfabric #microsoft #azure #dataengineering #adf

КОМЕНТАРІ

  • @katherineohearn1250
    @katherineohearn1250 19 годин тому

    Thank you so much, this worked perfectly! Great explanation and I appreciate you going step by step and showing how to evaluate your results with the data preview.

  • @Arman21079
    @Arman21079 21 годину тому

    How can I move already written Plugin code in azure function?

  • @priyankathakur1691
    @priyankathakur1691 23 години тому

    Well explained! Thanks for creating such useful videos. Do add more in the list for generating access token for PBI APIs.

  • @geethamca88
    @geethamca88 День тому

    Congratulations 🎉

  • @AmitSharma-pu8rz
    @AmitSharma-pu8rz День тому

    Content is very good but you are speaking fast , i think with 1x speed -- it appears to be 1.25 X , thus please do speak with a normal pace i suggest

  • @Hemant-k51
    @Hemant-k51 День тому

    CAN I GET YOUR PPT LINKS

  • @ashishkumar9538
    @ashishkumar9538 День тому

    Hi @Meheer... Thanks for the wonderful lecture. I do have a query. If i have a list of 100 database, creating 100 new triggers will not be a good solution. Cant we simply create a simple trigger which handle all the database at once

  • @auhumanmedium
    @auhumanmedium День тому

    Hi Maheer, Here for creating spark dataframe. Why you are passing ABFSS path instead of url. What is the difference. Thank You

  • @mahihi251
    @mahihi251 День тому

    Great, Congratulations Brother

  • @mohitupadhayay1439
    @mohitupadhayay1439 День тому

    There is no video fow how to call a stored procedure from Databricks on the internet and I am very surprised.

  • @chidellasrinivas
    @chidellasrinivas 2 дні тому

    hi maheer , even i am not getting the option for sanbox subscription. can you help

  • @esteban-alvino
    @esteban-alvino 2 дні тому

    Thank you for introducing databricks.

  • @shailajareddy4353
    @shailajareddy4353 2 дні тому

    Hi Maheer, I keep getting this error. File 'dfs.core.windows.net/storagecontainer/Financial Sample.xlsx' cannot be opened because it does not exist or it is used by another process. I assigned myself with storage blob data owner. That didn't work as well. Can you please assist me on this?

  • @battulasuresh9306
    @battulasuresh9306 2 дні тому

    @wafastudies Any new Batch starts for ADF?

  • @TheShortbiker
    @TheShortbiker 3 дні тому

    Great intro - very much appreciated.

  • @RahulKumar-g1t
    @RahulKumar-g1t 3 дні тому

    I want to learn quickly fast so please quickly update the next video

  • @B_maheshkumar_B
    @B_maheshkumar_B 3 дні тому

    Congratulations 🎉

  • @beigepiripitin4923
    @beigepiripitin4923 3 дні тому

    No sé entiende NADAAA

  • @charltondsouza9140
    @charltondsouza9140 4 дні тому

    Cant quite thank you enough for the 2 wonderful playlists u have...Azure Data Factory and Azure Synapse Analytics...So may scenarios covered in detail. Just wanted to know if you have designed any course/ playlist for Kafka and Docker?

  • @PavanEdu-tb4ss
    @PavanEdu-tb4ss 5 днів тому

    congrats!

  • @naiduparesh7827
    @naiduparesh7827 5 днів тому

    sir in source i can see mysql dataset which i have created. but in sink im not able to see dataset .How it is possible sir

  • @premanandramasamy
    @premanandramasamy 5 днів тому

    [Commenting on Jul 24] As per latest version, I think Unionall is not available right? So union works as UnionAll in spark. Kindly suggest.

  • @sateeshjadi9163
    @sateeshjadi9163 5 днів тому

    Hi bro , what is the difference between youtuber adf(104) videos vs live classes

  • @user-wl1lx9oh4q
    @user-wl1lx9oh4q 5 днів тому

    Bhai, how can i contact you?

  • @robinthomas7782
    @robinthomas7782 6 днів тому

    Is there any Apache spark video tutorial available?

  • @RahulKumar-bx9mn
    @RahulKumar-bx9mn 6 днів тому

    too much adds on your videos

  • @shruthikottary
    @shruthikottary 6 днів тому

    Very well explained

  • @anusha8129
    @anusha8129 6 днів тому

    Thankyou sir...

  • @shaileshsondawale8765
    @shaileshsondawale8765 6 днів тому

    How to use user delegation SAS Token to access the blob storage..?

  • @user-fg2gx6zd8l
    @user-fg2gx6zd8l 7 днів тому

    Well done! Nice solution for the non existing trigger: "scan the source directory if new files are added" :D

  • @shashichandra9680
    @shashichandra9680 7 днів тому

    Can you please share the PPT that you prepare with us?

  • @SrinuBabu-k2q
    @SrinuBabu-k2q 7 днів тому

    hi, I faced an error, while, saving data into a file by using the write method, or saveAsTextFile method like, "AttributeError: 'PipelinedRDD' object has no attribute 'savaAsTextFile'" in jupyter notebook IDE, try to solve this error

  • @sivaramreddivari1287
    @sivaramreddivari1287 7 днів тому

    Super good content.. 🎉

  • @javedkha2
    @javedkha2 7 днів тому

    How to mount using databricks managed Identity?

  • @itsartyficial1985
    @itsartyficial1985 7 днів тому

    Useful for interview thanks it was very helpful

  • @pigrebanto
    @pigrebanto 7 днів тому

    tks. does not work with dbfs: in the path. When files are local it works for me with file:/

  • @mohansaivelagapudi929
    @mohansaivelagapudi929 8 днів тому

    can i create Linked service for 100's of data sets in adf. i want to create only 1 linked service instead of 100 linked service and 100 datasets . is this azure key vault is enough.

  • @TinkuBhandari-tq7gl
    @TinkuBhandari-tq7gl 8 днів тому

    If somebody wants to purchase your azure synapse and adf recordings how to purchase that

    • @WafaStudies
      @WafaStudies 8 днів тому

      Very soon I am going to lunch in my website. Pls stay connected

  • @pushpinder2006
    @pushpinder2006 8 днів тому

    Good contents, but this guy talks way to fast. Hard to absorb info at this pace.

  • @khalandarshaik-cz5dt
    @khalandarshaik-cz5dt 8 днів тому

    congrats bhai

  • @subhashreechhualsingh8174
    @subhashreechhualsingh8174 8 днів тому

    Hello, I have one question. Suppose I have a complex sql query. Now I want to create one pipeline where I can store the output of this sql query as parameters , so that other pipelines who will call this pipeline can use these values. How to achieve that in adf?

  • @williamtenhoven8405
    @williamtenhoven8405 8 днів тому

    how would you proceed with a file who has got different (predictable) fixed lengths ?

  • @bharathivg2258
    @bharathivg2258 9 днів тому

    Sir, is this tutorial enough for pyspark learning??

  • @chetanreddy8061
    @chetanreddy8061 9 днів тому

    But how to rename the folder name to unzip

  • @g.suresh430
    @g.suresh430 10 днів тому

    Hi Maheer, In Synapse Playlist you have explained about Lake Databases. Is Lake Databases and LakeHouse both are same ?

  • @anusha8129
    @anusha8129 10 днів тому

    Thankyou sir...

  • @kalananr2884
    @kalananr2884 11 днів тому

    I have problem where are checking if sink has those data

  • @tempmail5660
    @tempmail5660 11 днів тому

    pleae6share your GitHub profile

  • @arvindkumar-s5m
    @arvindkumar-s5m 11 днів тому

    Hello can I speak to you? I am in Canada and looking to migrate a schema and all the tables in a Azure SQL database to Azure Synapse Analytics

  • @vijaykumarreddyt3287
    @vijaykumarreddyt3287 11 днів тому

    Best explanation