Skip to content

Timeout during run when building the whole project (dbt core) #327

@bgarcevic

Description

@bgarcevic

When I run dbt build on a small project for a POC I get a timeout around 20-30 models in. I can run the failing models after and they pass but it seems like a connectivity issues. Like I am opening up too many connections towards fabric and get throttled.

When I run the dbt build in a notebook I do not get a timeout.

profiles.yml
analytics:
target: dev
outputs:
dev:
type: fabric
driver: 'ODBC Driver 17 for SQL Server'
server: "{{ env_var('DBT_SERVER' }}"
database: 'Datahub'
schema: "{{ env_var('DBT_SCHEMA') }}" #
authentication: cli

Cleaned the logs for model names
Logs
12:33:51 Running with dbt=1.10.13
12:33:52 Registered adapter: fabric=1.9.6
12:33:53 Found 24 models, 16 data tests, 11 sources, 1 exposure, 986 macros
12:33:53
12:33:53 Concurrency: 1 threads (target='dev')
12:33:53
12:33:55 1 of 41 START sql view model .............. [RUN]
12:33:56 1 of 41 OK created sql view model ......... [OK in 0.84s]
12:33:56 2 of 41 START sql view model ........... [RUN]
12:33:56 2 of 41 OK created sql view model ...... [OK in 0.78s]
12:33:56 3 of 41 START sql view model ................... [RUN]
12:33:57 3 of 41 OK created sql view model .............. [OK in 0.41s]
12:33:57 4 of 41 START sql view model .................. [RUN]
12:33:57 4 of 41 OK created sql view model ............. [OK in 0.34s]
12:33:57 5 of 41 START sql view model ................ [RUN]
12:33:58 5 of 41 OK created sql view model d ........... [OK in 0.36s]
12:33:58 6 of 41 START sql view model ............. [RUN]
12:33:58 6 of 41 OK created sql view model ........ [OK in 0.81s]
12:33:58 7 of 41 START sql view model ........ [RUN]
12:33:59 7 of 41 OK created sql view model ... [OK in 0.54s]
12:33:59 8 of 41 START sql view model ................. [RUN]
12:34:00 8 of 41 OK created sql view model ............ [OK in 1.28s]
12:34:00 9 of 41 START sql view model ............. [RUN]
12:34:01 9 of 41 OK created sql view model ........ [OK in 0.37s]
12:34:01 10 of 41 START sql view model ........... [RUN]
12:34:01 10 of 41 OK created sql view model ...... [OK in 0.73s]
12:34:01 11 of 41 START sql view model .......... [RUN]
12:34:02 11 of 41 OK created sql view model ..... [OK in 0.83s]
12:34:02 12 of 41 START sql view model ..................... [RUN]
12:34:02 12 of 41 OK created sql view model ................ [OK in 0.32s]
12:34:02 13 of 41 START test not_null_ ....... [RUN]
12:34:03 13 of 41 PASS not_null_ ............. [PASS in 0.23s]
12:34:03 14 of 41 START test unique_ ......... [RUN]
12:34:03 14 of 41 PASS unique_ ............... [PASS in 0.46s]
12:34:03 15 of 41 START test not_null_ .............. [RUN]
12:34:04 15 of 41 PASS not_null_ .................... [PASS in 0.66s]
12:34:04 16 of 41 START test unique_ ................ [RUN]
12:34:04 16 of 41 PASS unique_ ...................... [PASS in 0.34s]
12:34:04 17 of 41 START test not_null_ ...................... [RUN]
12:34:05 17 of 41 PASS not_null_ ............................ [PASS in 0.50s]
12:34:05 18 of 41 START test unique_ ........................ [RUN]
12:34:05 18 of 41 PASS unique_ .............................. [PASS in 0.13s]
12:34:05 19 of 41 START sql table model ............................. [RUN]
12:34:08 19 of 41 OK created sql table model ........................ [OK in 3.31s]
12:34:08 20 of 41 START sql table model ........................ [RUN]
12:34:13 20 of 41 OK created sql table model ................... [OK in 5.02s]
12:34:13 21 of 41 START sql table model ........................... [RUN]
12:34:18 21 of 41 OK created sql table model ...................... [OK in 4.87s]
12:34:18 22 of 41 START sql table model ............................... [RUN]
12:34:20 22 of 41 OK created sql table model .......................... [OK in 2.35s]
12:34:20 23 of 41 START sql table model .......................... [RUN]
12:34:22 23 of 41 OK created sql table model ..................... [OK in 1.78s]
12:34:22 24 of 41 START sql table model .................. [RUN]
12:34:24 24 of 41 OK created sql table model ............. [OK in 1.79s]
12:34:24 25 of 41 START sql table model ........................ [RUN]
12:34:29 25 of 41 OK created sql table model ................... [OK in 5.46s]
12:34:29 26 of 41 START test not_null ............................. [RUN]
12:34:31 26 of 41 PASS not_null_ ................................... [PASS in 1.35s]
12:34:31 27 of 41 START test unique_ ............................... [RUN]
12:34:31 27 of 41 PASS unique_ ..................................... [PASS in 0.50s]
12:34:31 28 of 41 START sql view model ............................. [RUN]
12:35:42 28 of 41 ERROR creating sql view model .................... [ERROR in 70.51s]
12:35:42 29 of 41 START test not_null ........................ [RUN]
12:36:45 29 of 41 ERROR not_null ............................. [ERROR in 63.53s]
12:36:45 30 of 41 START test unique .......................... [RUN]
12:37:49 30 of 41 ERROR unique ............................... [ERROR in 63.51s]
12:37:49 31 of 41 START sql view model ................................... [RUN]
12:38:52 31 of 41 ERROR creating sql view model .......................... [ERROR in 63.48s]

12:38:52 32 of 41 START test not_null ..................... [RUN]
12:39:33 32 of 41 PASS not_null ........................... [PASS in 40.71s]
12:39:33 33 of 41 START test unique ....................... [RUN]
12:39:34 33 of 41 PASS unique ............................. [PASS in 0.55s]
12:39:34 34 of 41 START test not_null ...... [RUN]
12:39:34 34 of 41 PASS not_null ............ [PASS in 0.27s]
12:39:34 35 of 41 START test unique ........ [RUN]
12:39:34 35 of 41 PASS unique_ .............. [PASS in 0.21s]
12:39:34 36 of 41 START test not_null ....................... [RUN]
12:39:35 36 of 41 PASS not_null ............................. [PASS in 1.32s]
12:39:35 37 of 41 START test unique ......................... [RUN]
12:39:36 37 of 41 PASS unique ............................... [PASS in 0.41s]
12:39:36 38 of 41 START sql view model .................................. [RUN]
12:39:36 38 of 41 OK created sql view model ............................. [OK in 0.34s]
12:39:36 39 of 41 SKIP relation ....................................... [SKIP]
12:39:36 40 of 41 START sql view model ............................. [RUN]
12:39:37 40 of 41 OK created sql view model ........................ [OK in 0.80s]
12:39:37 41 of 41 SKIP exposure ...................................... [SKIP]
12:39:37
12:39:37 Finished running 1 exposure, 7 table models, 16 data tests, 17 view models in 0 hours 5 minutes and 44.23 seconds (344.23s).
12:39:37
12:39:37 Completed with 4 errors, 0 partial successes, and 0 warnings:
12:39:37
12:39:37 Failure in model (models\reporting)
12:39:37 Database Error in model (models\reporting)
('08001', '[08001] [Microsoft][ODBC Driver 17 for SQL Server]TCP Provider: Ventehandlingen blev midlertidigt afbrudt.\r\n (258) (SQLDriverConnect); [08001] [Microsoft][ODBC Driver 17 for SQL Server]Login timeout expired (0); [08001] [Microsoft][ODBC Driver 17 for SQL Server]A network-related or instance-specific error has occurred while establishing a connection to SQL Server. Server is not found or not accessible. Check if instance name is correct and if SQL Server is configured to allow remote connections. For more information see SQL Server Books Online. (258)')
12:39:37
12:39:37 compiled code at target\compiled\models\reporting
12:39:37
12:39:37 Failure in test not_null__ (models\analytics_analytics__models)
12:39:37 Database Error in test not_null (models\analytics_analytics__models)
('08001', '[08001] [Microsoft][ODBC Driver 17 for SQL Server]TCP Provider: Ventehandlingen blev midlertidigt afbrudt.\r\n (258) (SQLDriverConnect); [08001] [Microsoft][ODBC Driver 17 for SQL Server]Login timeout expired (0); [08001] [Microsoft][ODBC Driver 17 for SQL Server]A network-related or instance-specific error has occurred while establishing a connection to SQL Server. Server is not found or not accessible. Check if instance name is correct and if SQL Server is configured to allow remote connections. For more information see SQL Server Books Online. (258)')
12:39:37
12:39:37
12:39:37 Failure in test unique_(models\analytics_analytics__models.yml)
12:39:37 Database Error in test unique (models\analytics_analytics__models)
('08001', '[08001] [Microsoft][ODBC Driver 17 for SQL Server]TCP Provider: Ventehandlingen blev midlertidigt afbrudt.\r\n (258) (SQLDriverConnect); [08001] [Microsoft][ODBC Driver 17 for SQL Server]Login timeout expired (0); [08001] [Microsoft][ODBC Driver 17 for SQL Server]A network-related or instance-specific error has occurred while establishing a connection to SQL Server. Server is not found or not accessible. Check if instance name is correct and if SQL Server is configured to allow remote connections. For more information see SQL Server Books Online. (258)')
compiled code at target\run\models\analytics_analytics__models.yml\unique.sql
12:39:37
12:39:37 compiled code at target\compiled\models\analytics_analytics__models.yml\unique_.sql
12:39:37
12:39:37 Failure in model datoer (models\reporting.sql)
12:39:37 Database Error in model datoer (models\reporting.sql)
('08001', '[08001] [Microsoft][ODBC Driver 17 for SQL Server]TCP Provider: Ventehandlingen blev midlertidigt afbrudt.\r\n (258) (SQLDriverConnect); [08001] [Microsoft][ODBC Driver 17 for SQL Server]Login timeout expired (0); [08001] [Microsoft][ODBC Driver 17 for SQL Server]A network-related or instance-specific error has occurred while establishing a connection to SQL Server. Server is not found or not accessible. Check if instance name is correct and if SQL Server is configured to allow remote connections. For more information see SQL Server Books Online. (258)')
12:39:37
12:39:37 compiled code at target\compiled\models\reporting.sql
12:39:37
12:39:37 Done. PASS=35 WARN=0 ERROR=4 SKIP=2 NO-OP=0 TOTAL=41

Metadata

Metadata

Labels

bugSomething isn't working

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions