Home - addresses info - Content

Tutorial: Azure Data Lake Storage Gen2, Azure Databricks & Spark

# Run each of these queries, preferably in a separate cmd cell for separate analysis# create a temporary sql view for querying flight informationFlightTable = spark.read.parquet('/mnt/flightdata/parquet/flights')FlightTable.createOrReplaceTempView('FlightTable')# create a temporary sql view for querying airline code informationAirlineCodes = spark.read.parquet('/mnt/flightdata/parquet/airlinecodes')AirlineCodes.createOrReplaceTempView('AirlineCodes')# using spark sql, query the parquet file to return total flights in January and February 2016out1 = spark.sql("SELECT * FROM FlightTable WHERE Month=1 and Year= 2016")NumJan2016Flights = out1.count()out2 = spark.sql("SELECT * FROM FlightTable WHERE Month=2 and Year= 2016")NumFeb2016Flights = out2.count()print("Jan 2016: ", NumJan2016Flights, " Feb 2016: ", NumFeb2016Flights)Total = NumJan2016Flights+NumFeb2016Flightsprint("Total flights combined: ", Total)# List out all the airports in Texasout = spark.sql( "SELECT distinct(OriginCityName) FROM FlightTable where OriginStateName = 'Texas'")print('Airports in Texas: ', out.show(100))# find all airlines that fly from Texasout1 = spark.sql( "SELECT distinct(Reporting_Airline) FROM FlightTable WHERE OriginStateName='Texas'")print('Airlines that fly to/from Texas: ', out1.show(100, False))


1. To Bring Awareness of a New Cryptocurrency: Cryptocurrency is small in size and it is no big deal


- WELCOME TO THE FIRST STEP IN YOUR JOURNEY The world of digital assets and cryptocurrency is exciti

DBS BANK LTD Branches, Tamil Nadu, All Branch Addresses, Phone, IFSC code, MICR code, BankIFSCcode.com

2010 - 22, BankIFSCcode.comDisclaimer: - We have tried our best to keep the latest information updat