topic Re: Environment magic command? in Data Engineering

Environment magic command?

Kayla — Wed, 07 Aug 2024 14:16:21 GMT

Noticed something strange in the Databricks version control- I'm getting hidden commands with %environment that I can only see in the UI for version control. No idea what it's from, just a minor nuisance I'm curious if anyone can shed light on.

+ %environment
+ "client": "1"
+ "base_environment": ""

Re: Environment magic command?

RPalmer — Wed, 07 Aug 2024 15:04:50 GMT

We are seeing the same issue since yesterday. Like you we only see it in the version control UI and not in the actual notebook itself. These 3 lines are getting added and showing in version control even if I just open the notebook and don't make any changes. Where other changes have been made to the notebook and then committed to my branch the 3 lines are getting added as a separate cell at the end of the notebook.

Re: Environment magic command?

biafch — Wed, 07 Aug 2024 15:57:18 GMT

I'm having the same issue and really don't know what to do with it?

Re: Environment magic command?

crowley — Wed, 07 Aug 2024 17:05:49 GMT

same problem for me since yesterday; it is adding code arbitrarily to notebooks and that's a security risk to say the least... what other code is going to be added? what does this code do when devs keep missing it at the far bottom of large diffs?

Re: Environment magic command?

wrappid — Thu, 08 Aug 2024 09:16:15 GMT

yes this is bad. It's messing our diffs, cicd and creating conflicts

Re: Environment magic command?

MGencsoy — Thu, 08 Aug 2024 09:35:10 GMT

I have the same issue. Any fix for that?

Re: Environment magic command?

garvitkh — Mon, 12 Aug 2024 05:42:07 GMT

Same issue for me as well

Re: Environment magic command?

Kayla — Wed, 14 Aug 2024 17:38:49 GMT

@Retired_mod
Any chance we could get some weigh-in from Databricks?
Sounds like a lot of people are seeing this.

Re: Environment magic command?

RPalmer — Thu, 15 Aug 2024 10:57:23 GMT

At least in our case this issue seems to have stopped and in fact the necessary changes to remove these 3 rows showed yesterday when I went to commit a change to a notebook.

Are other people still seeing the 3 rows getting added?

Re: Environment magic command?

crowley — Fri, 16 Aug 2024 15:11:38 GMT

same, haven't seen the issue for a few days... and haven't seen any response from Databricks as to why it happened, or why it stopped.

Re: Environment magic command?

IvyD98 — Thu, 22 Aug 2024 20:49:59 GMT

may I know how it messed up your cicd?

Re: Environment magic command?

-werners- — Fri, 23 Aug 2024 08:22:37 GMT

My guess it was something that by accident was put into production.
Had the same issue for like 2 days (or even one) and it disappeared afterwards.

Re: Environment magic command?

justinbreese — Fri, 23 Aug 2024 19:01:49 GMT

Hello all, this is Justin from the PM team at Databricks. We are sorry about the friction this caused you. This was a feature related to the new way that we are doing dependency management in our serverless offerings - Environments. We are going to re-vamp the feature a bit so that it is not causing phantom diffs in your notebooks like this. I'll have some more updates in the coming weeks.

If you are using our Serverless offerings with repos then please email me (justin.breese@databricks.com) if you're interested in helping us shape this product area.