Click here to close now.

Welcome!

You will be redirected in 30 seconds or close now.

ColdFusion Authors: Yakov Fain, Maureen O'Gara, Nancy Y. Nee, Tad Anderson, Daniel Kaar

Related Topics: ColdFusion

ColdFusion: Article

Scalability and Rapid Development

Scalability and Rapid Development

One of ColdFusion's long-standing advantages over other Web development environments is time-to-market. It's not uncommon to hear stories of start-to-finish ColdFusion projects that take less than a month...or even a week. But these ultratight schedules allow little or no time for proper planning and testing prior to launch.

ColdFusion's simplicity and speed of development, which allows for the creation of powerful applications, doesn't reduce the importance of appropriate planning and testing in developing scalable applications. In the end, every Web application undergoes testing for both functionality and scalability. Some are tested prior to release as part of the development process. Others aren't fully tested until after their release, and by unsuspecting customers.

A firm understanding of the nature of rapid development and a brief review of the processes that lay the foundation for scalable application development will allow us to better understand how to achieve scalable applications rapidly.

Rapid Development for the Web
ColdFusion isn't the first product to offer rapid development other non-Web tools have similar accelerated development cycles. What is special about rapid development for the Web? The big difference lies in the deployment environment.

First, in the client/server world applications are generally released to a predictable, relatively small, restricted number of users in a controlled environment.

Web applications on the other hand are often released to an un-known, virtually unlimited number of potentially simultaneous users in the frequently unpredictable environment of the Web.

Second, while rolling out a client/server application often requires a significant effort, the effort required to deploy a Web application can be minimal. By simply deploying a code set to a single Web server, you can immediately reach thousands of users.

The possibility that you could so easily deploy an application to hundreds of thousands of simultaneous users adds significant risk to an application that wasn't developed with proper development methodology - and to the company behind it. With sound development practices, however, these risks can be minimized while still achieving rapid application development.

Scalable Application Development
Regardless of the development tools you use, the same basic principles of sound development hold. Appropriate resources need to be allocated for architectural planning, site reporting, database tuning, code analysis and tuning, representative staging, load and regression testing, server tuning, spike readiness, recovery planning and monitoring. While ColdFusion can substantially compress the time needed for some of these stages, it doesn't reduce the need for a proper development process.

A number of key considerations come into play when developing and deploying scalable Web applications. The information below is excerpted from a more detailed Allaire Knowledge Base article, #12970, available at http://www2.allaire.com/Handlers/index.cfm?ID=12970&Method=Full:

1. Architectural Planning
Plan the deployment, staging and development environments before launching your Web application. At the same time, growth requirements, security, proper testing and potential points of failure should be kept in mind. To better structure your code, understand your application's scalability requirements and existing constraints before starting development.

2. Site Reporting
Design your site with reporting in mind. Site reporting can range from log analysis to business and marketing trends to usage analysis. At its most basic level, it can provide useful diagnostic information about the relative traffic to different portions of your application or Web site. This information can be invaluable for troubleshooting and site planning. More sophisticated reporting can sometimes offer detailed information about site traffic, including the correlation of such information to back-end databases for more descriptive reporting. Some development architectures facilitate reporting while others hinder it.

3. Database Tuning
Run the database server(s) well below 50% of capacity to allow for load spikes. The vast majority of performance bottlenecks in database-driven applications stem from poorly tuned databases and queries. Every database-driven application can benefit from the active participation of a skilled database administrator (DBA) for both query and database tuning.

4. Code Analysis and Tuning
Consider a variety of alternative coding constructs to achieve optimum functionality and performance. Bear in mind that some are more efficient than others for a given task. Best-practices documents and the ColdFusion Server debugging features, including page-processing statistics, can facilitate your code quality analysis.

5. Representative Staging
Include allowances for application testing in a representative staging environment. You can use this environment to detect and correct deployment configuration issues before reaching final deployment.

6. Load and Regression Testing
Test your applications thoroughly for both functionality and performance under load. Many Web applications and sites in use have been only marginally tested under load prior to deployment, if at all. These applications often work fine under minimal or moderate load, but become unstable or unbearably lethargic under heavy load.

7. Server Tuning
Tune your servers thoroughly. Proper and thorough server tuning can often achieve significant performance improvements. Each Web application has its own distinct demands, stressing specific server resources and often requiring a distinct server configuration for optimal performance.

8. Spike Readiness
Plan for load spikes and develop contingency plans for rapid emergency system expansion. Load spikes can come when you least expect them. Your systems should be able to handle at least twice the regular peak load without additional resources. The extra bandwidth not only protects you against unexpected load spikes, it also can ensure application availability during unexpected partial outages or system maintenance.

9. Recovery Planning
Make a contingency plan for every possible failure point in your application deployment environment. Determine your acceptable downtime threshold, and plan your contingency plans accordingly.

10. Monitoring
Plan for monitoring. A scalable, stable Web project often involves various forms of monitoring, be they implicit or explicit. Any portion of your deployment environment that can fail is a candidate for some form of monitoring, be it periodic manual verification or some form of automated detection.

Conclusion
Tag-based technologies like ColdFusion provide extremely productive, scalable, rapid-development tools that can substantially reduce your time and costs of developing, deploying and maintaining Web applications. Remember, however, that they're not alternatives to proper development methodologies. They are catalysts to accelerate various stages of those methodologies.

As Web technology evolves, we'll continue to evolve our products to make those technologies imminently usable and accessible to Web developers. Web technologies will come and go, but sound development practices are here to stay.

More Stories By Brian Surkan

Brian Surkan has been with Allaire for almost three years. For the last year and a half he has focused on the day-to-day product management of ColdFusion Server. As a technical product
manager, he stewards the ongoing evolution of the ColdFusion product.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
The explosion of connected devices / sensors is creating an ever-expanding set of new and valuable data. In parallel the emerging capability of Big Data technologies to store, access, analyze, and react to this data is producing changes in business models under the umbrella of the Internet of Things (IoT). In particular within the Insurance industry, IoT appears positioned to enable deep changes by altering relationships between insurers, distributors, and the insured. In his session at @ThingsExpo, Michael Sick, a Senior Manager and Big Data Architect within Ernst and Young's Financial Servi...
The major cloud platforms defy a simple, side-by-side analysis. Each of the major IaaS public-cloud platforms offers their own unique strengths and functionality. Options for on-site private cloud are diverse as well, and must be designed and deployed while taking existing legacy architecture and infrastructure into account. Then the reality is that most enterprises are embarking on a hybrid cloud strategy and programs. In this Power Panel at 15th Cloud Expo (http://www.CloudComputingExpo.com), moderated by Ashar Baig, Research Director, Cloud, at Gigaom Research, Nate Gordon, Director of T...
“In the past year we've seen a lot of stabilization of WebRTC. You can now use it in production with a far greater degree of certainty. A lot of the real developments in the past year have been in things like the data channel, which will enable a whole new type of application," explained Peter Dunkley, Technical Director at Acision, in this SYS-CON.tv interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that Intelligent Systems Services will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Established in 1994, Intelligent Systems Services Inc. is located near Washington, DC, with representatives and partners nationwide. ISS’s well-established track record is based on the continuous pursuit of excellence in designing, implementing and supporting nationwide clients’ mission-critical systems. ISS has completed many successful projects in Healthcare, Commercial, Manufacturing, ...
PubNub on Monday has announced that it is partnering with IBM to bring its sophisticated real-time data streaming and messaging capabilities to Bluemix, IBM’s cloud development platform. “Today’s app and connected devices require an always-on connection, but building a secure, scalable solution from the ground up is time consuming, resource intensive, and error-prone,” said Todd Greene, CEO of PubNub. “PubNub enables web, mobile and IoT developers building apps on IBM Bluemix to quickly add scalable realtime functionality with minimal effort and cost.”
Sensor-enabled things are becoming more commonplace, precursors to a larger and more complex framework that most consider the ultimate promise of the IoT: things connecting, interacting, sharing, storing, and over time perhaps learning and predicting based on habits, behaviors, location, preferences, purchases and more. In his session at @ThingsExpo, Tom Wesselman, Director of Communications Ecosystem Architecture at Plantronics, will examine the still nascent IoT as it is coalescing, including what it is today, what it might ultimately be, the role of wearable tech, and technology gaps stil...
DevOps tends to focus on the relationship between Dev and Ops, putting an emphasis on the ops and application infrastructure. But that’s changing with microservices architectures. In her session at DevOps Summit, Lori MacVittie, Evangelist for F5 Networks, will focus on how microservices are changing the underlying architectures needed to scale, secure and deliver applications based on highly distributed (micro) services and why that means an expansion into “the network” for DevOps.
In the consumer IoT, everything is new, and the IT world of bits and bytes holds sway. But industrial and commercial realms encompass operational technology (OT) that has been around for 25 or 50 years. This grittier, pre-IP, more hands-on world has much to gain from Industrial IoT (IIoT) applications and principles. But adding sensors and wireless connectivity won’t work in environments that demand unwavering reliability and performance. In his session at @ThingsExpo, Ron Sege, CEO of Echelon, will discuss how as enterprise IT embraces other IoT-related technology trends, enterprises with i...
When it comes to the Internet of Things, hooking up will get you only so far. If you want customers to commit, you need to go beyond simply connecting products. You need to use the devices themselves to transform how you engage with every customer and how you manage the entire product lifecycle. In his session at @ThingsExpo, Sean Lorenz, Technical Product Manager for Xively at LogMeIn, will show how “product relationship management” can help you leverage your connected devices and the data they generate about customer usage and product performance to deliver extremely compelling and reliabl...
The Internet of Things (IoT) is causing data centers to become radically decentralized and atomized within a new paradigm known as “fog computing.” To support IoT applications, such as connected cars and smart grids, data centers' core functions will be decentralized out to the network's edges and endpoints (aka “fogs”). As this trend takes hold, Big Data analytics platforms will focus on high-volume log analysis (aka “logs”) and rely heavily on cognitive-computing algorithms (aka “cogs”) to make sense of it all.
The Internet of Everything (IoE) brings together people, process, data and things to make networked connections more relevant and valuable than ever before – transforming information into knowledge and knowledge into wisdom. IoE creates new capabilities, richer experiences, and unprecedented opportunities to improve business and government operations, decision making and mission support capabilities. In his session at @ThingsExpo, Gary Hall, Chief Technology Officer, Federal Defense at Cisco Systems, will break down the core capabilities of IoT in multiple settings and expand upon IoE for bo...
With several hundred implementations of IoT-enabled solutions in the past 12 months alone, this session will focus on experience over the art of the possible. Many can only imagine the most advanced telematics platform ever deployed, supporting millions of customers, producing tens of thousands events or GBs per trip, and hundreds of TBs per month. With the ability to support a billion sensor events per second, over 30PB of warm data for analytics, and hundreds of PBs for an data analytics archive, in his session at @ThingsExpo, Jim Kaskade, Vice President and General Manager, Big Data & Ana...
For years, we’ve relied too heavily on individual network functions or simplistic cloud controllers. However, they are no longer enough for today’s modern cloud data center. Businesses need a comprehensive platform architecture in order to deliver a complete networking suite for IoT environment based on OpenStack. In his session at @ThingsExpo, Dhiraj Sehgal from PLUMgrid will discuss what a holistic networking solution should really entail, and how to build a complete platform that is scalable, secure, agile and automated.
We’re no longer looking to the future for the IoT wave. It’s no longer a distant dream but a reality that has arrived. It’s now time to make sure the industry is in alignment to meet the IoT growing pains – cooperate and collaborate as well as innovate. In his session at @ThingsExpo, Jim Hunter, Chief Scientist & Technology Evangelist at Greenwave Systems, will examine the key ingredients to IoT success and identify solutions to challenges the industry is facing. The deep industry expertise behind this presentation will provide attendees with a leading edge view of rapidly emerging IoT oppor...
One of the biggest impacts of the Internet of Things is and will continue to be on data; specifically data volume, management and usage. Companies are scrambling to adapt to this new and unpredictable data reality with legacy infrastructure that cannot handle the speed and volume of data. In his session at @ThingsExpo, Don DeLoach, CEO and president of Infobright, will discuss how companies need to rethink their data infrastructure to participate in the IoT, including: Data storage: Understanding the kinds of data: structured, unstructured, big/small? Analytics: What kinds and how responsiv...
Cloudian, Inc., the leading provider of hybrid cloud storage solutions, today announced availability of Cloudian HyperStore 5.1 software. HyperStore 5.1 is an enhanced Amazon S3-compliant, plug-and-play hybrid cloud software solution that now features full Apache Hadoop integration. Enterprises can now transform big data into smart data by running Hadoop analytics on HyperStore software and appliances. This in-place analytics, with no need to offload data to other systems for Hadoop analyses, enables customers to derive meaningful business intelligence from their data quickly, efficiently and ...
Since 2008 and for the first time in history, more than half of humans live in urban areas, urging cities to become “smart.” Today, cities can leverage the wide availability of smartphones combined with new technologies such as Beacons or NFC to connect their urban furniture and environment to create citizen-first services that improve transportation, way-finding and information delivery. In her session at @ThingsExpo, Laetitia Gazel-Anthoine, CEO of Connecthings, will focus on successful use cases.
Sensor-enabled things are becoming more commonplace, precursors to a larger and more complex framework that most consider the ultimate promise of the IoT: things connecting, interacting, sharing, storing, and over time perhaps learning and predicting based on habits, behaviors, location, preferences, purchases and more. In his session at @ThingsExpo, Tom Wesselman, Director of Communications Ecosystem Architecture at Plantronics, will examine the still nascent IoT as it is coalescing, including what it is today, what it might ultimately be, the role of wearable tech, and technology gaps stil...
The true value of the Internet of Things (IoT) lies not just in the data, but through the services that protect the data, perform the analysis and present findings in a usable way. With many IoT elements rooted in traditional IT components, Big Data and IoT isn’t just a play for enterprise. In fact, the IoT presents SMBs with the prospect of launching entirely new activities and exploring innovative areas. CompTIA research identifies several areas where IoT is expected to have the greatest impact.
Wearable devices have come of age. The primary applications of wearables so far have been "the Quantified Self" or the tracking of one's fitness and health status. We propose the evolution of wearables into social and emotional communication devices. Our BE(tm) sensor uses light to visualize the skin conductance response. Our sensors are very inexpensive and can be massively distributed to audiences or groups of any size, in order to gauge reactions to performances, video, or any kind of presentation. In her session at @ThingsExpo, Jocelyn Scheirer, CEO & Founder of Bionolux, will discuss ho...