Using Nuget package feed from PowerShell in Azure pipeline

2022-05-04 10:52 Richard Barraclough imported from Stackoverflow

I'm trying to write a pipeline PowerShell task that checks that package version numbers in the csproj files have been incremented -- so that the push step doesn't fail because of duplicates when building new release packages. (We use allowPackageConflicts: false on the NuGetCommand@2 command: push task.)

The problem is to get Find-Package to use my Azure DevOps NuGet feed that all the packages go to.

- task: PowerShell@2
  displayName: 'Check package version numbers'
  inputs:
    targetType: 'inline'
    script: |
      [bool] $bad = $false;

      Get-PackageSource
      [Net.ServicePointManager]::SecurityProtocol = [Net.SecurityProtocolType]::Tls12
      Register-PackageSource -Name TheAzureDevOpsFeed -Trusted -Force -ProviderName NuGet -Location "https://pkgs.dev.azure.com/Organisation/_packaging/TheAzureDevOpsFeed/nuget/v3/index.json"
      Get-PackageSource
    
      foreach( $csproj in Get-ChildItem **\*.csproj ) {
          $m = Select-String -Path $csproj.FullName -Pattern '<VersionPrefix>([\d\.]+)</VersionPrefix>'
          $pkgName = [System.IO.Path]::GetFileNameWithoutExtension($csproj.FullName)
          echo $pkgName
          if( $m.Matches.Count -eq 1 )
          {
              $csprojVersion = $m.Matches[0].Groups[1].Value
              
              $pkg = $null
              try {
                  $pkg = Find-Package $pkgName -Source TheAzureDevOpsFeed -ErrorAction Stop
              }
              catch {
                  $pkg = $null
              }

              if( $pkg -eq $null )
              {
                  echo "  No existing package."
                  continue
              }
              $current = $pkg.Versions[0].OriginalVersion
    
              if( [System.Version]"$csprojVersion" -le [System.Version]"$current" )
              {
                  echo "  REJECTED: current version is $current but csproj has version $csprojVersion."
                  $bad = $true
              }
              else {
                echo "  $current -> $csprojVersion"
              }
          }
          else {
              echo "  skipped"
          }
      }
    
      if( $bad ) {
        exit 1
      }
      exit 0

When the task runs the output is:

Name                             ProviderName     IsTrusted  Location                                                  
----                             ------------     ---------  --------                                                  
nuget.org                        NuGet            False      https://api.nuget.org/v3/index.json                       
PSGallery                        PowerShellGet    False      https://www.powershellgallery.com/api/v2                  
Register-PackageSource : Source Location 
'https://pkgs.dev.azure.com/Organisation/_packaging/TheAzureDevOpsFeed/nuget/v3/index.json' is not valid.
At D:\a\_temp\62c6a3fb-93a6-4d4a-8cf5-ce5dc7d9dcbf.ps1:7 char:1
+ Register-PackageSource -Name TheAzureDevOpsFeed -Trusted -Force -Provi ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidData: (TheAzureDevOpsFeed:String) [Register-PackageSource], Exception
    + FullyQualifiedErrorId : SourceLocationNotValid,Microsoft.PowerShell.PackageManagement.Cmdlets.RegisterPackageSou 
   rce

But why is it 'not valid'? It is valid -- it works fine in VisualStudio.

Things I've tried:

single quotes, double quotes, no quotes,
[Net.ServicePointManager]::SecurityProtocol = [Net.SecurityProtocolType]::Tls12,
-Location https://pkgs.dev.azure.com/.../v2

1 answer

answered 2022-05-05 06:46 Bowman Zhu-MSFT
I can reproduce your issue:

How I solve this:
```
$patToken = "<Your PAT here>" | ConvertTo-SecureString -AsPlainText -Force

$credsAzureDevopsServices = New-Object System.Management.Automation.PSCredential("<Your email address that related to PAT here>", $patToken)

Register-PackageSource -Name "xxx" -Location "https://pkgs.dev.azure.com/<organizaton name>/_packaging/<feed name>/nuget/v2" -ProviderName NuGet -Credential $credsAzureDevopsServices
```
Please refer to these official documents:

https://docs.microsoft.com/en-us/powershell/module/packagemanagement/register-packagesource?view=powershell-7.2

https://docs.microsoft.com/en-us/azure/devops/artifacts/tutorials/private-powershell-library?view=azure-devops#connecting-to-the-feed-as-a-powershell-repo

Let me know if you have more concerns.

See also questions close to this topic

How to exclude tagged commit
I have a build pipeline in Azure Pipelines with
```
trigger:
  branches:
    include:
    - '*'
  tags:
    include:
    - v/*
```
In other words: I build all branches (in practice I only have one), and all tags that start with v/ (these are my releases).

When I push a commit and its tag, Azure Pipelines kicks off two builds - one for the branch and one for the tag - even though they're the same commit. This takes up unnecessary pipeline resources, particularly when I want to release from many repositories at the same time.

Is there a way to skip the "branch build" of a commit (or cancel if ongoing) when a "tag build" of the same commit is started?

Automate Azure Devops (FTP Upload) and Git to upload on Remote Server

The current setup is as below

Version Control - Git
Repos and Branch hosted on - Azure DevOps
Codebase - External server

The dev team clones Azure Repo into local git project and any staged changes are committed via Git and pushed to specific branch of Azure DevOps. In this setup we would want to upload the changes to external FTP servers and avoid manual upload. Currently trying to use Azure Devops FTP Upload Task (https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/utility/ftp-upload?view=azure-devops), however facing issues; yaml script as below

trigger:
- main

pool:
  vmImage: 'ubuntu-latest'

variables:
  phpVersion: 7.4
  webAppName: 'Test Project'
  buildConfiguration: 'Release'
  vmImageName: 'ubuntu-latest'

steps:

- publish: $(System.DefaultWorkingDirectory)/AzureRepoName
  artifact: Test Project Deploy

- task: FtpUpload@2
  displayName: 'FTP Upload'
  inputs:
    credentialsOption: inputs
    serverUrl: 'ftps://00.00.00.00:22'
    username: ftp-username
    password: ftp-password
    rootDirectory: '$(System.DefaultWorkingDirectory)/AzureRepoName'
    remoteDirectory: '/home/public_html'
    clean: false
    cleanContents: false
    preservePaths: true
    trustSSL: true

PROBLEM

Following errors occur when I commit (for test purposes) something.

Starting: PublishPipelineArtifact
==============================================================================
Task         : Publish Pipeline Artifacts
Description  : Publish (upload) a file or directory as a named artifact for the current run
Version      : 1.199.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/publish-pipeline-artifact
==============================================================================
Artifact name input: Test Project Deploy
##[error]Path does not exist: /home/vsts/work/1/s/AzureRepoName
Finishing: PublishPipelineArtifact

I want to upload any staged change that is committed to main branch on Azure Devops to be automatically deploy on the remote FTP server

Thanks

Migrate Azure Devops Artifacts between organizations

I am trying to migrate (clone) an Azure Devops project to another project / organization. I successfully

cloned the repos
migrated the work items using Azure DevOps Migration Tools by NkdAgility
I exported the build and release pipelines as json files and imported them again.
I created a selfhosted agent on my VM and trying to run the build pipelines - the job "dotnet restore" on that.
I created a new feed under Artifacts. Unfortunately the job with dotnet restore fails because it relies on the artifacts only available in the old project

How can I migrate the packages from the feeds of the old project to the new one(s)?

I assume I am supposed to clone the feeds of the old project somehow so that I can simply update the nuget.config with the name of the new organization. Thank you in advance.

<?xml version="1.0" encoding="utf-8"?>
<configuration>
  <packageSources>
    <!-- remove any machine-wide sources with <clear/> -->
    <clear />
    <!-- also get packages from the NuGet Gallery -->
    <add key="nuget.org" value="https://api.nuget.org/v3/index.json" />
    <add key="DotNetArcade" value="https://dotnetfeed.blob.core.windows.net/dotnet-core/index.json" />
    <add key="<OLD_FEED1" value="https://pkgs.dev.azure.com/<old org>/_packaging/<OLD_FEED1>/nuget/v3/index.json" />
    <add key="<OLD_FEED2" value="https://pkgs.dev.azure.com/<old org>/_packaging/<OLD_FEED2>/nuget/v3/index.json" />
    <add key="<OLD_FEED3" value="https://pkgs.dev.azure.com/<old org>/_packaging/<OLD_FEED3>/nuget/v3/index.json" />
  </packageSources>
  <activePackageSource>
    <add key="All" value="(Aggregate source)" />
  </activePackageSource>
</configuration>

nuget “-Allversions” is invalid

I am migrating all packages from nuget. Server to Baget and I have a problem: I used the nuget list command in the migration. But I found that the -allversions parameter does not list all package versions. what should I do, my Baget server only has the latest package. How can I migrate all versions of all packages? I use version of 5.1 nuget cli
Visual Studio: Centralized Output Folder - No 3rd Party Libraries Copied

I have a C# solution containing many projects (DLL and EXE projects) and decided to centralize the Output folder so that Visual Studio builds all projects to one folder (instead of a bin folder inside each project). This works fine, all can see all the DLLs and EXE from my projects output in this folder.

But 3rd dependencies (all acquired via NuGet) like EntityFramework do not copy automatically to the centralized output folder. All references have Copy To Local set to true. What am I doing wrong?
Azure DevOps trigger at pipeline completion using different branch than expected
In the workflow of a pipeline triggering another pipeline according to this doc, I'm trying to set:
1. feature-branch PR to develop-branch triggers stage-ci
2. stage-ci runs, triggers stage-cd
3. pipeline stage-cd runs
But in step 3, it gets the default branch, not the feature-branch. Does anyone know why this is happening? When the trigger in stace-ci is trigger (not pr) it works fine

stage-ci.yaml:
```
trigger: none

pr:
  branches:
    include:
    - develop
```
stage-cd.yaml
```
trigger: none

pr: none

resources:
  pipelines:
  - pipeline: stage-ci
    source: stage-ci
    trigger: true
```
Azure DevOps pipeline how set vcvars64.bat then call msbuild.exe from batch file?
On a local machine, I execute my build.bat after opening a x64 Native Tools Command Prompt for VS 2019, then build.bat calls msbuild.exe.
```
call "C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\VC\Auxiliary\Build\vcvars64.bat"
build.bat
```
How can I do same in an Azure DevOps pipeline CmdLine task?

The build.bat call to msbuild.exe fails when called from azure-pipelines.yml CmdLine task.

Is there a reliable method to locate and call vcvars64.bat so that msbuild.exe can be found?
```
- task: CmdLine@2
  displayName: 'build.bat calls msbuild'
  inputs:
    script: |
      build.bat
```
Azure pipeline error:
```
2022-05-06T15:42:53.3802703Z 'msbuild' is not recognized as an internal or external command,
2022-05-06T15:42:53.3803010Z operable program or batch file.
```
Thanks in advance for any tips or direction.
How to pass a parameter to commandToExecute in Azure Custom Script Extension
I have a Azure Vm extension in which i want to run a PowerShell script which takes a parameter -Install:
```
PS C:\Users\abc\Downloads\InstallPackage-2022\InstallPackage> .\Install_Package.ps1 -Install
```
How can i use this in the commandToExecute?

So far I have:

Custom Script Extension commandToExecute:
```
$settings = @{"fileUris" = $fileUri;"commandToExecute" ="powershell -ExecutionPolicy Unrestricted -File Install_Package.ps1"};
```
Azure Devops - Azure boards / teams with no work items

I am looking for any PowerShell az DevOps/ az boards code that can get the list of boards in a project where there are no workitems ever. I don't think any WIQL is out there but correct me if I am wrong.
Azure Devops > How to retrieve Service Connection information with powershell?

Good morning Azure expert,

I configured a service connexion with Azure cloud environment in my Azure DevOps server like below

Then in my release I have a Powershell script which need to retrieve some information like TenantID/ SP id / SP secret / Subscription ID.

I do not want to create release variable to avoid duplication.

I'm pretty sure these variables could be retrieve with powershell but I have totally no idea on how to do it. Do you have any idea - suggestions - recommendation ?

Regards, Terry

Related questions

Using Nuget package feed from PowerShell in Azure pipeline

1 answer

See also questions close to this topic