development lifecycles Questions

Dear Experts,

Need your expter advice in setting up a new repository structure for our product development.

We have a software product, with 15-compnents and each of the 15-components have at least 15-modules.

Earlier our admin guy had configured the Stash server for us.

The current setup is like this:
Our IT engineer had created 15-Projects in stash/bitbucket server for 15-Components
For each of the 15-modules in a given component, a individual repository was created

Thus we have around 225 + 25(for additional module), totally 250 repositories to manage.

Individual developers creates their feature branches on their respective repositories and merge them to their production branch in their respective repo, after release.

Feature branches gets created only on a particular module in a particular repository which is getting affected for that feature.

If a developer is working on a feature, which is affecting 10-modules, this developer creates a branch in each of the repository which is affectting this module. Thus he creates 10-branches for a given feature in 10-different repositories.

In this way, we have many small teams working on many individual repositories corresponding to their module. Packages are made from each of the individual repository and delivered to our infra team, who deploys the product on our hosted servers.

Since source is spread all over the place, there is no baselines/tags created for this product. Also managing these many repositories by a single CM admin is too much to handle.

As a CM admin, I’m thinking of suggesting this structure for this product.
Create a single Project (Project A) in Stash 
Create a single repository (Repo A ) in this project 
Create a folder for each Component, i.e 15-Folders, under the repository root 
(i.e Project A - /RepoA/Component1/Module1 Module2 ……Module15
/RepoA/Component2/Module1 Module2 ……Module15
/RepoA/Component3/Module1 Module2 ……Module15
:
:
/RepoA/Folder15/Module1 Module2 ……Module15)

In this way we’ll have single repository to handle and CM admin will create branches and developers will just make changes and commit their code.

Appreciate your response on these lines:

1. Is my suggestion to host a single repository for all the components correct? 
is this achievable, what is your opinion on this repository structure?

2. We are developing a multi-tier, web application using PHP, Python, and Java Script. This application gets deployed on multiple servers. By using this single repository structure, do you see any issue or obstacle at a later stage on the line of development? What precautions should we take, if any?

3. Since the application is multi-tier, developers actually develop the application in the development environment (where multiple servers are setup to create a production sort of environment) using the shared work area in the environment, at times there are chances of one developer overwriting the others' changes.

What is your opinion on this kind of development?

4. Using this repository structure, how do we resolve the conflicts? Whenever a developer tries to push/pull the changes, he/she might face multiple conflicts not only from their changes. Should we call all developers to assemble at one desk and resolve the conflicts or is there any other better way?

5. We have many set of features getting developed on different branches. At times, many components are not modified in the some branches, still we just package them and release. What is your advice on this?

As CM admin, I see lots of advantages in managing branches and merges in a single repository structure. What do you suggest for our kind of development.

I have read many articles on web about the advantages/disadvantages of having single/multiple repositories. My Dev team is not conveienced with my approach.  Thus I need answers to all my(actually their's) question in one place.

Would appreciate your detailed response for each of the above issues that we are facing.  Your assistance in this regard will be very much appreciated.

Eagerly awaiting your response.

 

Thanking you,

Deepak.

In practice I have two new features that are under change control and that I want to be able to track them as separate changes from the first change and until the features are deployed to production.
 
How do I handle the fact that they both need to make the same changes to one part of the code? If I let one of them carry the change but then decides later on to back out of that “Feature” then I  will break the other feature that where depending on the same change. 
 
I am curious to know of any good advice or best practices to use i CM when dealing with those type of scenarios. 
 
We use MS TFS as version control and status accounting tool, but I am really interested in learning about best practice in general.
 
Thanks Johan.

By Paul Perry - December 18, 20151 Answer

Hello Everyone,

I'd like to understand how companies using SVN, TFS, Git, GitHub perform backing out production deployments from two perspectives, your re-deployment method but more importantly, how are you indicating in your respective repo that if code was rolled back, what are you doing internally with your SCM tool to force a message to developers that code was backed out.

Thanks

Paul Perry

CM, ALM Engineer in Toronto, ON - web, tfs, sql - [email protected]

I am using the JHSDK jar available in ths installation directory of CA to write a java program for an automation project.

 

I am using the below Java code to select the packages from ACEDEV13.06.00.00 from SW Development view and promoting it to next stage 'Integration Test(AIT)'.

 

Java Code:

 

JCaContext context = harvest.getContext();

boolean approve = context.setApprove("Approve"); //Exception @ this line is E0309000d: ERROR: Could not get Process.

boolean promote = context.setPromote("Promote");

 

//Setting the Approval

CaApprove jcaApprove = context.getApprove();

jcaApprove.setApprove(true);

jcaApprove.setDescription("Approved Desc");

jcaApprove.execute();

 

//Setting the Promote

JCaPromote jcaPromoteObj =  context.getPromote();

System.out.println(" getToStateName "+jcaPromoteObj.getToStateName());

System.out.println(" getToStateObjId "+jcaPromoteObj.getToStateObjId());

 

jcaPromoteObj.execute();

 

 

Exception I get :

com.ca.harvest.jhsdk.hutils.JCaHarvestException: E03090027: ERROR: Could not get Approve Process from Context.

com.ca.harvest.jhsdk.hutils.JCaHarvestException: E03090010: ERROR: Could not get Promote Process from Context.

 

Do I need to set any mode to context or harvest object to make the Promote process to work. Kindly help me with this.

By BenN - April 19, 20131 Answer

Hi all,

We are currently implementing agile, and have a fully realised development cycle in place.  I have now been tasked with implementing a deployment tech stack.  We are currently running a Subversion repository, feeding in to a Jenkins / Maven continuous integration platform, and an Artefactory Repository for compiled code.  We then have no path out of Artefactory (at the moment, the devs are packaging up complete WARs of the environment and copying manually to the target area).  I want to implement a continuous deployment solution, that can be used by developers for small fixes and by tech leads for large releases.

I have looked around but am struggling to find a tool to realise this that will integrate with our current tech (everything seems to want to replace Jenkins etc with their own agent based build / test / artifact solution).  Does anyone know of software that will allow me to automate the movement of compiled code from our dev platform to  our test environment, then on to prod, setting rules and checks along the way? 

Many thanks in advance,

Ben

By Mani P - April 12, 20131 Answer

We have some need to allow self-registration with ClearQuest for some database. We have integrated CQ with LDAP. Appreciate your ideas on the same.

One way i thought is too have link in CQ startup screen for self-registration which will get all relevant info from user and via perl create new account in CQ.

We have an ongoing disagreement going on here about how do we identify CI's and their relationship to the Indentured product list.

By Bob Aiello - March 10, 20137 Answers

Hi everyone,

my esteemed colleague Marc Bools and I have started working on bringing back the CM Wiki and we want you to help us with the design and requirements of a new CM Wiki!!!

Here is a hight level list of the topics from the old wiki. This is your chance to help!!

Topics you will find in the CM web 

Definitions: 

  • Configuration Management 
  • Software Configuration Management 
  • Build Management 
  • Change Management 

Tools: 

  • CM Tools - Software and tools for Change and Configuration Control - HCM/SCM 
  • CM Integrations - Integration of CM tools with other tools 
  • Frequently Asked Questions 

Concepts and theories: 

  • ConfigurationManagementBodyOfKnowledge (a.k.a. CMBoK ™) 
  • CM versus SCM - Thoughts on the differences between the terms CM and SCM 
  • CM Metrics - What you could gain in time and money when using CM. 
  • CM Metaphors and Analogies -- metaphors and analogies for describing CM 

Processes and practices: 

  • Agile Development and Agile SCM - Ideas on Agile Development and how it affects CM 
  • Configuration Management Process 
  • Change Management Process 
  • Branching and Merging for Parallel Development 
  • CM and Web Engineering 
  • CM and Databases 

Templates and Examples: 

  • CM Templates - Quick templates to help you start implementing a CM solution 

Vendors: 

  • TBD 

Other: 

  • Suite Vs Best Of Breed 
  • SCM Readings - Some recommended SCM books and papers 
  • History of CM 
  • WhosWhoInSCM  

Starting points

  • TBD 

What other topics should we include?? How do we provide more value from our new and improved CM Wiki.

Drop me a line and get involved!

Bob Aiello
Editor in Chief
[email protected]

Hi everyone,

as always we love to get YOUR input on which topics we should be covering in the coming months. 
Obviously, DevOps is hot, Cloud & Mobile are essential. We have had many issues dedicated to CM for Small Teams, Process and more process and tips and strategies for Build Engineers.

What topics would you like us to cover? What topics would you like to write about yourself??
(Hint - I will help you! - just contact me directly)

Bob Aiello
Editor in Chief
http://www.linkedin.com/in/BobAiello
[email protected]

Pages

CMCrossroads is a TechWell community.

Through conferences, training, consulting, and online resources, TechWell helps you develop and deliver great software every day.