Refactored and added new tests and data for Date, GroupBy operations, Value functions and other scenarios

testframework/data/PQSDKTestData.md

@@ -11,13 +11,16 @@ The modified dataset is open for anyone to use under the [CDLA-Permissive-2.0 li
 
 The PQ SDK Test Framework dataset contains the below files:
 
-- **nyc_taxi_tripdata.csv** file which contains 10000 rows sampled from the February 2023 green trip data
+- **nyc_taxi_tripdata.csv** file with 10000 rows sampled from the February 2023 green trip data
+- **nyc_taxi_trip_date_data.csv** file with 10000 rows containing record identifier and two date columns processed from
+  the February 2023 green trip data
 - **taxi+\_zone_lookup.csv** file which contains 265 rows from the taxi zone lookup table
 - **PQSDKTestFrameworkDataSchema.sql** file contains the schema for NyxTaxiGreen and TaxiZoneLookup table
 
 ## PQ SDK Test Framework - Test Data Loading
 
 The PQ SDK Test Framework dataset needs to be loaded to the datasource for your extension connector before running the
 PQ SDK Testframework Test Suites. The data is provided in convenient csv format so that it can be easily be loaded to
-any datasource. The **nyc_taxi_tripdata.csv** and **taxi+\_zone_lookup.csv** files should be respectively loaded into
-NyxTaxiGreen and TaxiZoneLookup tables as per the schema specified in the **PQSDKTestFrameworkDataSchema.sql** file.
+any datasource. The **nyc_taxi_tripdata.csv**, **nyc_taxi_trip_date_data.csv** and **taxi+\_zone_lookup.csv** files
+should be respectively loaded into **NycTaxiData**, **NycTaxiDateData** and **TaxiZoneLookup** tables as per the schema
+specified in the **PQSDKTestFrameworkDataSchema.sql** file.

testframework/data/PQSDKTestFrameworkDataSchema.sql

@@ -3,33 +3,38 @@ NOTE:
 1) While uploading to the data source, all decimal values should have a scale of 2. That is, the number of digits after the decimal point should be 2. 
 2) All timestamp values should be uploaded to the datasouce in MM/DD/YYYY HH24:MI:SS format.
 */
+CREATE TABLE NycTaxiGreen(
+	RecordID int,
+	VendorID int,
+	lpep_pickup_datetime timestamp,
+	lpep_dropoff_datetime timestamp,
+	store_and_fwd_flag boolean,
+	RatecodeID int,
+	PULocationID int,
+	DOLocationID int,
+	passenger_count int,
+	trip_distance double,
+	fare_amount double,
+	extra double,
+	mta_tax double,
+	tip_amount double,
+	tolls_amount double,
+	improvement_surcharge double,
+	total_amount double,
+	payment_type int,
+	trip_type int,
+	congestion_surcharge double
+);
 
-CREATE TABLE NycTaxiGreen (
-    RecordID int,
-    VendorID int,
-    lpepPickupDatetime timestamp,
-    lpepDropoffDatetime timestamp,
-    storeAndFwdFlag boolean,
-    RateCodeID int,
-    PULocationID int,
-    DOLocationID int,
-    passenger_count int,
-    trip_distance double,
-    fare_amount double,
-    extra double,
-    mta_tax double,
-    tip_amount double,
-    tolls_amount double,
-    improvement_surcharge double,
-    total_amount double,
-    payment_type int,
-    trip_type int,
-    congestion_surcharge double
+CREATE TABLE NycTaxiGreenDate (
+    RecordID int NOT NULL,
+	lpep_pickup_time date NOT NULL,
+	lpep_dropoff_time date NULL
 );
 
 CREATE TABLE TaxiZoneLookup (
-    LocationId int,
-    Borough string,
-    Zone string,
-    service_zone string	
+    LocationID int,
+	Borough string,
+	Zone string,
+	service_zone string
 );