Home - mlb ftx - Content

Tutorial: Azure Data Lake Storage Gen2, Azure Databricks & Spark

# Run each of these queries, preferably in a separate cmd cell for separate analysis# create a temporary sql view for querying flight informationFlightTable = spark.read.parquet('/mnt/flightdata/parquet/flights')FlightTable.createOrReplaceTempView('FlightTable')# create a temporary sql view for querying airline code informationAirlineCodes = spark.read.parquet('/mnt/flightdata/parquet/airlinecodes')AirlineCodes.createOrReplaceTempView('AirlineCodes')# using spark sql, query the parquet file to return total flights in January and February 2016out1 = spark.sql("SELECT * FROM FlightTable WHERE Month=1 and Year= 2016")NumJan2016Flights = out1.count()out2 = spark.sql("SELECT * FROM FlightTable WHERE Month=2 and Year= 2016")NumFeb2016Flights = out2.count()print("Jan 2016: ", NumJan2016Flights, " Feb 2016: ", NumFeb2016Flights)Total = NumJan2016Flights+NumFeb2016Flightsprint("Total flights combined: ", Total)# List out all the airports in Texasout = spark.sql( "SELECT distinct(OriginCityName) FROM FlightTable where OriginStateName = 'Texas'")print('Airports in Texas: ', out.show(100))# find all airlines that fly from Texasout1 = spark.sql( "SELECT distinct(Reporting_Airline) FROM FlightTable WHERE OriginStateName='Texas'")print('Airlines that fly to/from Texas: ', out1.show(100, False))

Starkare tjänstekonjunktur i USA senaste månaden

Logga in gratis och ta del av Marknadsnytt Artikeln är en del av vår exklusiva nyhetstjänst Marknads

Cryptocurrency Exchange

CEX.IO Made It Easy to Work and Earn With Crypto Among the numerous websites providing Bitcoin excha

Coinbase Wallet

Though not a lock to make the Reds’ rotation on a team that could use a salary floor , the team’s to