Azure devops pipelines, inspect ftp traffic during release

2020-11-23 10:11 Adam Stawarek imported from Stackoverflow

Is there a way to log detailed ftp traffic from microsoft hosted agent? In my case, when running ui tests in release pipeline, screenshoots are uploaded to ftp server. It worked fine for few weeks unitl yesterday when I started getting following errors:

There was no change on the ftp server side and in c# code used for uploading ftp files. Uploading files still works fine when i run tests locally and this issue happens only when they are run from pipeline, so I thought about comparing network traffic, looking for some clues.

1 answer

answered 2020-11-24 02:29 Kevin Lu-MSFT

Is there a way to log detailed ftp traffic from microsoft hosted agent?

You could try to use the network tracing to collect the Ftp traffic log.

You could add the configuration in the config file (e.g. web.config , app.config).

For example: To collect the FTPWebRequest and FtpWebResponse information, you could use system.net.

<configuration>
  <system.diagnostics>
    <sources>
      <source name="System.Net" tracemode="protocolonly" maxdatasize="1024">
        <listeners>
          <add name="System.Net"/>
        </listeners>
      </source>
    </sources>
    <switches>
      <add name="System.Net" value="Information"/>
    </switches>
    <sharedListeners>
      <add name="System.Net"
        type="System.Diagnostics.TextWriterTraceListener"
        initializeData="network.log"
      />
    </sharedListeners>
    <trace autoflush="true"/>
  </system.diagnostics>
</configuration>

Then it will create a network.log file.

Since you are using the Microsoft-Hosted agent, you could determine the file location and use the Publish Build Artifacts task to upload the file as build artifacts.

See also questions close to this topic

Decimal vs Double?
I'm new to C#, and I want to use a trackbar for the forms opacity This is my code
```
decimal trans = trackBar1.Value / 5000
this.Opacity = trans
```
When I try to build it, I get this error

Cannot implicitly convert type 'decimal' to 'double

I tried making trans a double, but then the control doesn't work. This code worked fine for me in VB.NET. Any suggestions?

Set RestSharp content-type to application/x-www-form-urlencoded

I don't seem to be able to change content-type to application/x-www-form-urlencoded. I found and tested similar answers but nothing seems to work. What am I doing wrong?

request.Method = Method.POST;
        client.Authenticator = new HttpBasicAuthenticator(ABclientID, ABclientSecret);
        request.Parameters.Clear();
        request.AddHeader("Accept", "application/x-www-form-urlencoded");
        request.Parameters.Clear();
        request.AddParameter("application/x-www-form-urlencoded", $"grant_type=client_credentials&scope=account-info-setup", ParameterType.RequestBody);
        IRestResponse response = client.Execute(request);
        Response.Write(response.Content.ToString());

I also tried the following code:

        request.Method = Method.POST;
        client.Authenticator = new HttpBasicAuthenticator(ABclientID, ABclientSecret);
        request.AddHeader("content-type", "application/x-www-form-urlencoded");
        request.AddParameter("application/x-www-form-urlencoded", $"grant_type=client_credentials&scope=account-info-setup", ParameterType.RequestBody);
        IRestResponse response = client.Execute(request);
        Response.Write(response.Content.ToString());

WPF MVVM model SelectAll checkbox not working

i have a checkbox .when i click selectall all the checkbox should select/deselect.I am following MVVM pattern.i have tried below code but not working.i am using the listview here for showing the data

Xaml

    <ListView Grid.Row="1" Name="listbox" ItemsSource="{Binding Items}"   Margin="5,5,5,5" Width="Auto" >

        <ListView.View >
            <GridView  >

            <GridViewColumn Width="80"  >
                <GridViewColumn.Header >
                    <CheckBox  x:Name="cbSelectAll" IsChecked="{Binding ModelDetails.IsChecked}"  Command="{Binding cbSelectAll_Checked}"/>
                </GridViewColumn.Header>

                <GridViewColumn.CellTemplate>
                    <DataTemplate>
                        <StackPanel Orientation="Horizontal">
                            <WrapPanel x:Name="Layout"   >
                             
                                <CheckBox  IsChecked="{Binding ModelDetails.IsSelected, Mode=TwoWay, UpdateSourceTrigger=PropertyChanged}" />
                             
                            </WrapPanel>
                        </StackPanel>
                    </DataTemplate>
                </GridViewColumn.CellTemplate>
            </GridViewColumn>
            <GridViewColumn Header="File Name" Width="500" >
                    <GridViewColumn.CellTemplate >
                        <DataTemplate>
                            <TextBlock Name="TextBlock1" Height="30" Width="200"  Text="{Binding Name}" TextAlignment="Center"  />
                        </DataTemplate>
                    </GridViewColumn.CellTemplate>
                </GridViewColumn>

Model.cs

class TypeModel : INotifyPropertyChanged
    {
        private bool _isSelected;
        private bool _isChecked;
        //Define an event based on delegates
        public event PropertyChangedEventHandler PropertyChanged;
        //Raise the event
        public void OnPropertyChanged(string propertyName)
        {
            if (PropertyChanged != null)
            {
                //publishing the event in current classs
                PropertyChanged(this, new PropertyChangedEventArgs(propertyName));
            }
        }

        

        public bool IsChecked
        {
            get
            {
                return this._isChecked;
            }
            set
            {
                this._isChecked = value;
                this.OnPropertyChanged("IsChecked");
            }
        }
       

        public bool IsSelected
        {
            get
            {
                return _isSelected;
            }
            set
            {
                _isSelected = value;
                OnPropertyChanged("IsSelected");
            }
        }

ViewModel

 private ViTypeModel _ModelDetails;


        public ViTypeModel ModelDetails
        {
            get
            {
                return _ModelDetails;
            }
            set
            {
                _ModelDetails = value;
            }
        }






  public void SelectAllBtnExecute(object param)//onbutton click event
    {
        if (ModelDetails.IsChecked==true)
        {
            foreach (var selectedItems in Items)
            {
                ModelDetails.IsSelected = true;
            }
        }
        else
        {
            foreach (var selectedItems in Items)
            {
                ModelDetails.IsSelected = false;
            }
        }
    }

when i click on checkbox cbSelectAll_Checked is hitting. help me .help he to find the error.is this the right binding?

thanks in advance.

Azure Datawarehouse Materialized view causing an issue in Database project Visual Studio 2019

I have created a database project using the target as Azure SQL Datawarehouse in Visual Studio 2019 by importing the database. When I click on build it throws me an error for Materialized views. Since this is already present in the Datawarehouse it should not create an issue while creating a dacpac file.

Can you let me know if anyone has faced similar issue?
Getting empty response when sending request to "Get Suites by Test Case ID"

I am working with an API to create/update TFS test cases and lots of times the Outcome of newly created ones stays as Active instead the real test result. That happens because after receiving a "workitem.created" event from TFS webhooks I perform a request to endpoint _apis/test/suites?testCaseId={testCaseId} but I got the following response: {"value":[],"count":0}.

It might be just a time issue.

Does anyone have any idea what could be done to handle that?
Deploy ShinyProxy and an application with Azure DevOps

I'm trying to deploy a ShinyProxy in a Docker container to Azure. Also, I have the ShinyApp repositories in Azure DevOps. Every time a developer updates the code in a repository, I want to the CD/CI deploy the new code creating a Docker container to Azure.

Also, I think, I have to create an internal Docker network between the ShinyProxy and the app.

How can I create this process? Is there any tutorial how to setup a pipeline in Azure DevOps and run a ShinyProxy on Azure?

jenkinsfile fail when I'm using docker in it

I'm using Jenkins 2.263.1 & I want to use docker with pipeline. My jenkinsfile is:

pipeline {
    agent {
        docker {
           image 'android-build:android-gradle'
           args '-v $PWD/Android:/app -w /app'
        }
    }
    stages {
        stage('Build') {
        steps {
            sh 'cd /app && ./gradlew build'
            }
        }
    }
}

I get the following error:

Started by user bani ertebat mahan
Obtained Jenkinsfile from git http://git.banicodevelopers.com/ci-cd/android-app.git
Running in Durability level: MAX_SURVIVABILITY
[Pipeline] Start of Pipeline
[Pipeline] node
Running on Jenkins in /var/lib/jenkins/workspace/Android-App
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Declarative: Checkout SCM)
[Pipeline] checkout
The recommended git tool is: NONE
using credential cd5d4a9e-e5e5-4808-b1a4-dcac90da701f
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url http://git.banicodevelopers.com/ci-cd/android-app.git # timeout=10
Fetching upstream changes from http://git.banicodevelopers.com/ci-cd/android-app.git
 > git --version # timeout=10
 > git --version # 'git version 1.8.3.1'
using GIT_ASKPASS to set credentials 
 > git fetch --tags --progress http://git.banicodevelopers.com/ci-cd/android-app.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
Checking out Revision d02dcbf66909c49106ea102d94c42df03d424cc4 (refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d02dcbf66909c49106ea102d94c42df03d424cc4 # timeout=10
Commit message: "remove --rm options"
 > git rev-list --no-walk 64ad06f998001cb9cbedb8b88df32cfe8a86b679 # timeout=10
[Pipeline] }
[Pipeline] // stage
[Pipeline] withEnv
[Pipeline] {
[Pipeline] isUnix
[Pipeline] sh
+ docker inspect -f . android-build:android-gradle
.
[Pipeline] withDockerContainer
Jenkins does not seem to be running inside a container
$ docker run -t -d -u 998:996 -v $PWD/Android:/app -w /app -w /var/lib/jenkins/workspace/Android-App -v /var/lib/jenkins/workspace/Android-App:/var/lib/jenkins/workspace/Android-App:rw,z -v /var/lib/jenkins/workspace/Android-App@tmp:/var/lib/jenkins/workspace/Android-App@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** android-build:android-gradle cat
$ docker top c8729930a9b86c9ea66bfd674e233c75778d61376edfb7278d930acc6401595a -eo pid,comm
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Build)
[Pipeline] sh
+ ./gradlew build
/var/lib/jenkins/workspace/Android-App@tmp/durable-83d3c6ea/script.sh: 1: /var/lib/jenkins/workspace/Android-App@tmp/durable-83d3c6ea/script.sh: ./gradlew: not found
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
$ docker stop --time=1 c8729930a9b86c9ea66bfd674e233c75778d61376edfb7278d930acc6401595a
$ docker rm -f c8729930a9b86c9ea66bfd674e233c75778d61376edfb7278d930acc6401595a
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
ERROR: script returned exit code 127
Finished: FAILURE

Despite me never defining -w,-d,-u,-t options in my jenkisfile, they are being defined.

I mean just define one -w option but, it also define for /var/lib/jenkins/workspace/

I have added jenkins user to docker group.

Any help appreciated.

How to conditionally add a pipeline element in bash
I need to form a pipeline of various commands. Some elements of the pipeline, or sequences of elements, are only relevant when some condition holds. Now, I could write:
```
if [[ $whatever ]]; then
   cmd1 | cmd2 | cmd3 | cmd4
else
   cmd1 | cmd4
fi
```
but that means repeating cmd1 and cmd4, plus, there may be several conditions and I don't want to write nested if's. So, I tried writing this:
```
if [[ $whatever ]]; then
    pipeline_segment="| cmd2 | cmd3"
else
    pipeline_segment=""
fi

cmd1 ${pipeline_segment} | cmd4
```
but - the pipe symbol was not interpreted as an instruction to use a pipe.

How do I have bash execute the pipeline I want it too?

Note: You may assume a bash version of 4 or higher, but only if you must.
Azure DevOps Server 2019 - Create pipeline - No GitHub yaml option in Where is Your Code

I have Azure Devops server 2019 update 1.1, I understand from a couple of videos that when we try to create a new pipeline, we should see several options as follows

whereas on my server, there is no "Githyb Yaml", only enterprise or othergit

Am I missing a config or an update? Thanks

Related questions

Azure devops pipelines, inspect ftp traffic during release

1 answer

See also questions close to this topic